Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
Bpyne
New Member

Removing duplicate values

I am fairly new at this, and not sure if this feature is available. 

My data is connected to a external database using a url link created by the the database and pasted in Power Bi for th source of my data.  I am trying to create a function where I have a set list shown on a dashboard and as my data is updated/refreshed (every 3 hrs)  if it finds a duplicate it either removes it from the list, or highlights it to indicate it is a duplicate. Basically I am looking for a easy weekly compliance visualization.

 

If my set list was ABC and as my data refreshes, B submits something, B would then be removed or shaded out telling me that A and C still have to submit. Also wondering if it could reset each week.

1 ACCEPTED SOLUTION
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

View solution in original post

1 REPLY 1
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

July Power BI Update Carousel

Power BI Monthly Update - July 2026

Check out the July 2026 Power BI update to learn about new features.

60 days of Data Days Carousel

Data Days 2026

Join Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Top Solution Authors