Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

A new Data Days event is coming soon! This time we’re going bigger than ever. Fabric, Power BI, SQL, AI and more. Don't miss out.

Reply
Bpyne
New Member

Removing duplicate values

I am fairly new at this, and not sure if this feature is available. 

My data is connected to a external database using a url link created by the the database and pasted in Power Bi for th source of my data.  I am trying to create a function where I have a set list shown on a dashboard and as my data is updated/refreshed (every 3 hrs)  if it finds a duplicate it either removes it from the list, or highlights it to indicate it is a duplicate. Basically I am looking for a easy weekly compliance visualization.

 

If my set list was ABC and as my data refreshes, B submits something, B would then be removed or shaded out telling me that A and C still have to submit. Also wondering if it could reset each week.

1 ACCEPTED SOLUTION
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

View solution in original post

1 REPLY 1
Anonymous
Not applicable

@Bpyne,

If you intend to remove duplicates, just right-click on the column in your table in Query Editor of Power BI Desktop, then select "Remove Duplicates". This way, each time you refresh the table in Power BI Desktop, you will always get unique values in the column.

1.JPG

Another method to identify duplicates is to use Power Query or DAX. For more details, please review the example in the similar blog and thread below.

https://www.excelguru.ca/blog/2015/12/09/identify-duplicates-using-power-query/
http://community.powerbi.com/t5/Desktop/Identify-duplicates-and-show-up-records/td-p/210061

Regards,
Lydia

Helpful resources

Announcements
May Power BI Update Carousel

Power BI Monthly Update - May 2026

Check out the May 2026 Power BI update to learn about new features.

Fabric SQL PBI Data Days

Data Days 2026 coming soon!

Sign up to receive a private message when registration opens and key events begin.

New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.