Forum Discussion
I can't remove duplicates.
Yes. I used trim and it worked,
You've already done the uppercase thing, which gets a lot of people. Do you have some values with hidden characters? If so, try adding a trim step before your Remove Duplicates step.
Also, if not already, you can make a table visual with that column and add it again to get the count of rows, then sort by that to see which ones have >1 and are causing your issue.
Pat
Pat
I found the duplicates. I think deleting duplicates isn't working because it only deletes for the top 1000 rows in power query.
Hi Anonymous ,
Removing duplicates does not only apply to top 1000 rows. it applies to your whole table. top 1000 rows is only for preview. Try checking other columns those might be the cause of data duplicate.
Hope this helps.
However, I still cannot remove them. Power Query does not work and it has too many rows and won't let me filter.
The 1000 rows is just the preview. The Remove Duplicates step works on the whole dataset when it loads. Were you able to make a table visual that shows with values are duplicated?
Pat
I made the table. However, I cannot delete the values. I am currently just using a many to many relationship. Since the two sets of duplicates are the same throughout the row, the many to many relationship functions the same as a one to many.
