Forum Discussion

PowerBI_Query's avatar
PowerBI_Query
Helper II
1 year ago

Filter duplicate rows with latest date

I have a data table as shown in the sample file   Sheet1 (before) 

I need the output as shown in Sheet2 (after)

The data is not sorted. I need to exclude duplicate rows using latest date as criteria and retain non-duplicate numbers as it is.

9 Replies

  • Your link doesn't work, but one way is to 

    • Group the table by whatever columns you wish to check for duplications
    • Select the row with the latest date
    • Re-expand the grouped table

     

    Table.Group(#"Previous Step",#"List_of_Cols_to_Check_For_Duplicates",{
            {"DeDuped", (t)=>Table.SelectRows(t, each [Date]=List.Max(t[Date]))}

     

    The code is placed as an additional step in the Advanced Editor.

     

      • ronrsnfld's avatar
        ronrsnfld
        Super User

        Away from my computer now. If you can't figure it out from my answer, I'll check back later.

    • PowerBI_Query's avatar
      PowerBI_Query
      Helper II

      There are several numbers with their respective dates so I can't select a date manually

      • ronrsnfld's avatar
        ronrsnfld
        Super User

        Nowhere in my code am I selecting your date manually. You merely need to know the name of the column that contains the dates and the columns that you wish to check for possible duplications. 

        The table group function will select the appropriate date. 

        • The process I listed is merely what the code does.

         

         

  • The link doesn't work for me if you could provide a screen of your data, that would be great but based on the general description, you can easily add a column and provide the number reputation of each row and the napply filter, or you can use table.group as mentioned in the above

    • PowerBI_Query's avatar
      PowerBI_Query
      Helper II

      Before (data is unsorted) highlighted number are repetetive need number in A column with latest date in M column. 

      After