Forum Discussion

terrells's avatar
terrells
Regular Visitor
8 years ago

Still duplicates after removing duplicates

After removing duplicates there are still some duplicates remaining. The Table summary at the bottom of the table knows that there are duplicates as it says TABLE: Dimension_PF (63,036 rows) COLUMN: ...
Data Modeling
v-qiuyu-msft's avatar
v-qiuyu-msft
Icon for Community Support rankCommunity Support
8 years ago

Hi terrells,

 

Please check if the column "Public Folder Path" contains uppercase or lowercase for the same character, for example, the column has two values "A" and "a", it will be treat as distinct value. While after loading to data model, those two characters will be treat as the same character (based on my test, it's "A"). 

 

 

Best Regards,
Qiuyun Yu

cam0082's avatar
cam0082
Frequent Visitor
7 years ago

Hello! Had the same issue.

 

What you need to do is add a Trim step before the Remove Duplicates in the Query Editor. It happens you can have "XYZ " (with blank spaces at the end) and "XYZ". PowerBi will count the as independent values. Trim function will eliminate those blank spaces at the end.

 

Best regards,

Cris

  • Anonymous's avatar
    Anonymous
    Not applicable
    7 years ago

    This worked for me. Thank you so much

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    Thank you cam0082. I was struggling with this issue for a long time. Never occurred to me that this might be the case