Forum Discussion
Removing duplicate values
I am fairly new at this, and not sure if this feature is available.
My data is connected to a external database using a url link created by the the database and pasted in Power Bi for th source of my data. I am trying to create a function where I have a set list shown on a dashboard and as my data is updated/refreshed (every 3 hrs) if it finds a duplicate it either removes it from the list, or highlights it to indicate it is a duplicate. Basically I am looking for a easy weekly compliance visualization.
If my set list was ABC and as my data refreshes, B submits something, B would then be removed or shaded out telling me that A and C still have to submit. Also wondering if it could reset each week.
Bpyne,
If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.
Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.
https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061
Regards,
Lydia
1 Reply
Bpyne,
If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.
Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.
https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061
Regards,
Lydia