Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Try your skills in the Power BI Dataviz World Championship! Round one ends June 26. Join now

Reply
Bpyne
New Member

Removing duplicate values

I am fairly new at this, and not sure if this feature is available. 

My data is connected to a external database using a url link created by the the database and pasted in Power Bi for th source of my data.  I am trying to create a function where I have a set list shown on a dashboard and as my data is updated/refreshed (every 3 hrs)  if it finds a duplicate it either removes it from the list, or highlights it to indicate it is a duplicate. Basically I am looking for a easy weekly compliance visualization.

 

If my set list was ABC and as my data refreshes, B submits something, B would then be removed or shaded out telling me that A and C still have to submit. Also wondering if it could reset each week.

1 ACCEPTED SOLUTION
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

View solution in original post

1 REPLY 1
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

Helpful resources

Announcements
Fabric Data Days is here Carousel

Data Days 2026

Don't miss out on Data Days, June 15 through August 7. Learn Fabric, Power BI, SQL, AI and more.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.