Forum Discussion
Removing Duplicates
Hello, I am trying to remove duplicates from a data set in Power BI. Evertime I try to remove duplicates it does not apply to my entire data set. I have tried using formulas and the remove duplicates feature from the task bar and everything only applies to the first 1000 rows of the data set. Has anyone ever experienced this and knows how to fix it?
When you are loading the data in Power Query to transform, by default it only uses the top 1000 rows.
In the images, you will see the area 'Column profiling based on the top 1000 rows.
Click on this, to change to Column profiling based on the entire data set.
2 Replies
- fooddCommunity Champion
When you are loading the data in Power Query to transform, by default it only uses the top 1000 rows.
In the images, you will see the area 'Column profiling based on the top 1000 rows.
Click on this, to change to Column profiling based on the entire data set.
- kdivenRegular Visitor
Hi Thank you so much for responding, I acctually tried this and received the same error. Do you know of anything else I could do to resolve this?