Removing Dupes Using Power Query

[Anonymous]

Hi all,

I'm working with a bunch of COVID-19 open source data (see sample below). There's some duplicate values for one particular date that I would like that remove. Is there a way to filter to this date, remove duplicate values, then unfilter the date (to retain the original dataset minus the dupes), and then apply?

At the moment if I filter the TimeStampDate column to the date, I'm forced to apply that filter to the dataset when I close and apply (ie the dataset is now only one date). I'm sure there's a simple solution to this but I'm new-ish to PBI so it's not apparent to me.

Appreciate the help!

[Anonymous · Accepted solution]

Hi @Anonymous ,

You may consider using the following steps.

1. Add a index column.

2. Duplicate the table.

3. In Table(2)-->Filtered rows.

4. Select the columns to be de-duplicated --> Keep duplicates.

5. In Table --> Merge queries.([Index]--[Index])

6. expand [Index].

7. Filtered rows and remove rows.

Best Regards,
Gao
Community Support Team

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

[HotChilli]

It's possible but you wouldn't normally remove duplicates this way.

What duplicates are you trying to remove? Are they visible in the picture?