Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
nerdyplayer
Helper I
Helper I

remove duplicates per year

I have a data set where that i want to filter out duplicate entries per year. Tried looking on here and doing group by, got an error during the process. 

Table audit test

ICN    Year

V1234 2019

V1234 2020

V1234 2020

V1234 2021

V2345 2019

V2345 2019

V2345 2020

 

want

V1234 2019

V1234 2020

V1234 2021

V2345 1029

V2345 2020

 

1 ACCEPTED SOLUTION
quantumudit
Super User
Super User

Hey @nerdyplayer 

It is actually much simpler than you might have anticipated.

 

If I have understood your requirement correctly, all you need to do is select both columns, namely "ICN" and "Year," then right-click and choose "Remove Duplicates." You can select multiple columns by holding down the CTRL key.

 

Here is the sample GIF for your referece:

remove_duplicates.gif

Best Regards,
Udit

If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.
Appreciate your Kudo 👍

🚀 Let's Connect: LinkedIn || YouTube || Medium || GitHub
Visit My Linktree: LinkTree

Proud to be a Super User

 

 

View solution in original post

2 REPLIES 2
techies
Super User
Super User

Hi @nerdyplayer create a custom column

= Text.From([ICN]) & "-" & Text.From([Year])

 

and then use remove rows>remove  duplicates in this new column

― Power BI | Microsoft Fabric | PL-300 | DP-600 | Blog: medium.com/@cseprs_54978
quantumudit
Super User
Super User

Hey @nerdyplayer 

It is actually much simpler than you might have anticipated.

 

If I have understood your requirement correctly, all you need to do is select both columns, namely "ICN" and "Year," then right-click and choose "Remove Duplicates." You can select multiple columns by holding down the CTRL key.

 

Here is the sample GIF for your referece:

remove_duplicates.gif

Best Regards,
Udit

If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.
Appreciate your Kudo 👍

🚀 Let's Connect: LinkedIn || YouTube || Medium || GitHub
Visit My Linktree: LinkTree

Proud to be a Super User

 

 

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.