Forum Discussion
Still duplicates after removing duplicates
After removing duplicates there are still some duplicates remaining. The Table summary at the bottom of the table knows that there are duplicates as it says TABLE: Dimension_PF (63,036 rows) COLUMN: ...
Just ran into this problem and I found that tranforming the field to UPPERCASE, then TRIM, CLEAN, (right click the column name, all are under Transform) and then removing duplicates works. For whatever reason PBI recognizes ABC, abc, Abc, AbC, &c each distinct values (even blanks before and/or after create new distinct values) when removing duplicates however changing everything to uppercase, then trim, clean, and THEN removing duplicates seems to bypass any of the inconsistent rules that Microsoft hasn't bothered to fix or at least be clear about.
This issue was taking years off my life, thank you so much!