Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
3 years ago
Solved

Removing Dupes Using Power Query

Hi all,

 

I'm working with a bunch of COVID-19 open source data (see sample below). There's some duplicate values for one particular date that I would like that remove. Is there a way to filter to this date, remove duplicate values, then unfilter the date (to retain the original dataset minus the dupes), and then apply?

 

At the moment if I filter the TimeStampDate column to the date, I'm forced to apply that filter to the dataset when I close and apply (ie the dataset is now only one date). I'm sure there's a simple solution to this but I'm new-ish to PBI so it's not apparent to me.

 

Appreciate the help!

 

 

Need Help

2 Replies

  • HotChilli's avatar
    HotChilli
    Community Champion
    3 years ago

    It's possible but you wouldn't normally remove duplicates this way.

    What duplicates are you trying to remove? Are they visible in the picture?

  • Anonymous's avatar
    Anonymous
    Not applicable
    3 years ago

    Hi Anonymous ,

    You may consider using the following steps.

    1. Add a index column.

    2. Duplicate the table.

    3. In Table(2)-->Filtered rows.

    4. Select the columns to be de-duplicated --> Keep duplicates.

    5. In Table --> Merge queries.([Index]--[Index])

    6. expand [Index].

    7. Filtered rows and remove rows.

     

    Best Regards,
    Gao
    Community Support Team

     

    If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

    How to get your questions answered quickly --  How to provide sample data in the Power BI Forum