Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Enhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.

Reply
Bpyne
New Member

Removing duplicate values

I am fairly new at this, and not sure if this feature is available. 

My data is connected to a external database using a url link created by the the database and pasted in Power Bi for th source of my data.  I am trying to create a function where I have a set list shown on a dashboard and as my data is updated/refreshed (every 3 hrs)  if it finds a duplicate it either removes it from the list, or highlights it to indicate it is a duplicate. Basically I am looking for a easy weekly compliance visualization.

 

If my set list was ABC and as my data refreshes, B submits something, B would then be removed or shaded out telling me that A and C still have to submit. Also wondering if it could reset each week.

1 ACCEPTED SOLUTION
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

View solution in original post

1 REPLY 1
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

Helpful resources

Announcements
August Power BI Update Carousel

Power BI Monthly Update - August 2025

Check out the August 2025 Power BI update to learn about new features.

August 2025 community update carousel

Fabric Community Update - August 2025

Find out what's new and trending in the Fabric community.