Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Learn more

Reply
anshpalash
Helper II
Helper II

Remove Duplicates Across Multiple Tables

Hi,

 

I have two separate tables that contain an ID column. The ID column in both tables should have unique values. That is, an ID in one table should not repeat in the other table.

 

I know how to remove duplicates from a single column in a single table. But how do I consider removing duplicates in an ID column in two different tables?

 

Also, how can I see how many duplicate IDs are there across the two columns in the two tables?

 

Any help is much appreciated. 

1 ACCEPTED SOLUTION
mattww
Responsive Resident
Responsive Resident

Hi @anshpalash 

 

You could append the two tables together, creating one long table and then remove the duplicates from there. 

 

If you wanted to identify IDs with duplicates, use this appended table, right click on the ID column, select Group By and leave the operation as "Count Rows", this will then give you a count of how many records have that ID, so anything above 1 is a duplicate. 

 

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

1 REPLY 1
mattww
Responsive Resident
Responsive Resident

Hi @anshpalash 

 

You could append the two tables together, creating one long table and then remove the duplicates from there. 

 

If you wanted to identify IDs with duplicates, use this appended table, right click on the ID column, select Group By and leave the operation as "Count Rows", this will then give you a count of how many records have that ID, so anything above 1 is a duplicate. 

 

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
Fabric Data Days Carousel

Fabric Data Days

Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors