Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us for an expert-led overview of the tools and concepts you'll need to become a Certified Power BI Data Analyst and pass exam PL-300. Register now.

Reply
EWBWEBB
Helper III
Helper III

Remove duplicates based on condition

Hello,

 

I'm trying to establish how I can remove the duplicates from set of data but chose the one to remove based on a condition. 

 

I have a record of people currently off work.

These entries are repeated each month.

I've got power query to sort it all out and return a neat list with a unique identifier of the persons name and the first day they are off. 

 

I want to remove any duplicates so I have a single list, but when one of the duplicates has a return date entered I want to keep that and remove those where the date isn't entered.

 

If there is a duplicate and none have a return date entered then it doesn't matter which one is removed.

 

If there is a duplicate where they both have the same start and return date then it doesn't matter which is removed.

 

Attached is a file that has some sample data and then a 2 additional column I've populated in excel to show if it is a duplicate and then what I would want the decision to be.

 

Hope this makes sense.

 

The below should give you an anonymised sample data

https://we.tl/t-uAGS6a9jQH 

2 REPLIES 2
BA_Pete
Super User
Super User

Hi @EWBWEBB ,

 

I may be oversimplifying this, but can't you just group on [Name] and [FIRST DAY], then add an aggregated column that is MAX of [RESUMED].

 

It gives you this:

BA_Pete_0-1693496637475.png

 

Pete



Now accepting Kudos! If my post helped you, why not give it a thumbs-up?

Proud to be a Datanaut!




I'll give this a go - I thought i tried it and it came up with a strange error but I'll need to loop back to it to try it out. 

Thanks

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 Power BI Update Carousel

Power BI Monthly Update - June 2025

Check out the June 2025 Power BI update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.