Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Power BI is turning 10! Let’s celebrate together with dataviz contests, interactive sessions, and giveaways. Register now.

Reply
nerdyplayer
Helper I
Helper I

remove duplicates per year

I have a data set where that i want to filter out duplicate entries per year. Tried looking on here and doing group by, got an error during the process. 

Table audit test

ICN    Year

V1234 2019

V1234 2020

V1234 2020

V1234 2021

V2345 2019

V2345 2019

V2345 2020

 

want

V1234 2019

V1234 2020

V1234 2021

V2345 1029

V2345 2020

 

1 ACCEPTED SOLUTION
quantumudit
Super User
Super User

Hey @nerdyplayer 

It is actually much simpler than you might have anticipated.

 

If I have understood your requirement correctly, all you need to do is select both columns, namely "ICN" and "Year," then right-click and choose "Remove Duplicates." You can select multiple columns by holding down the CTRL key.

 

Here is the sample GIF for your referece:

remove_duplicates.gif

Best Regards,
Udit

If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.
Appreciate your Kudo 👍

🚀 Let's Connect: LinkedIn || YouTube || Medium || GitHub
Visit My Linktree: LinkTree

Proud to be a Super User

 

 

View solution in original post

2 REPLIES 2
techies
Solution Sage
Solution Sage

Hi @nerdyplayer create a custom column

= Text.From([ICN]) & "-" & Text.From([Year])

 

and then use remove rows>remove  duplicates in this new column

― Power BI | Microsoft Fabric | PL-300 | DP-600 | Blog: medium.com/@cseprs_54978
quantumudit
Super User
Super User

Hey @nerdyplayer 

It is actually much simpler than you might have anticipated.

 

If I have understood your requirement correctly, all you need to do is select both columns, namely "ICN" and "Year," then right-click and choose "Remove Duplicates." You can select multiple columns by holding down the CTRL key.

 

Here is the sample GIF for your referece:

remove_duplicates.gif

Best Regards,
Udit

If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.
Appreciate your Kudo 👍

🚀 Let's Connect: LinkedIn || YouTube || Medium || GitHub
Visit My Linktree: LinkTree

Proud to be a Super User

 

 

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 Power BI Update Carousel

Power BI Monthly Update - June 2025

Check out the June 2025 Power BI update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.