Forum Discussion

lroush13189's avatar
lroush13189
Frequent Visitor
5 years ago
Solved

Removing duplicates based on time response criteria

I have a report that has me stumped. I am looking to filter out duplicate records but I need to keep the record that has the quickest response time by the driver (Duration). Due to the large file siz...
  • v-jingzhang's avatar
    5 years ago

    Hi lroush13189 , 

    You could add these two steps into your query. Modify column names and step names per your need. The first step is to add a new column "MinDurationRow" containing the row with the minimum duration value for each tracking number. The second step is to expand the result of previous step.

    Custom1 = Table.Group(#"Added Custom", {"TrackingNumber"}, {{"MinDurationRow", each Table.FirstN(Table.Sort(_,{{"Duration", Order.Ascending}}),1), type any }}),
    #"Expanded Count" = Table.ExpandTableColumn(Custom1, "MinDurationRow", {"CallTime", "ArrivalTime", "Duration"}, {"CallTime", "ArrivalTime", "Duration"})

    Kindly let me know if this helps.
    Community Support Team _ Jing Zhang
    If this post helps, please consider Accept it as the solution to help other members find it.

  • v-jingzhang's avatar
    v-jingzhang
    5 years ago

    Hi lroush13189 You can achieve this by using the UI interface. Please follow below steps. Here is a PBIX file for your reference.

    1. Right click the last step in Applied Steps and select Insert Step After option, this will add a new Custom1 step.

    2. In Custom1 step, copy and paste below codes into the formula bar above the table. In my example, "Changed Type" is its previous step's name. Change it according to your previous step. "MinDurationRow" is the name for a new column.

    3. Click Expand icon on the new "MinDurationRow" column, select the columns you need and click OK. You will get the rows you want.

    = Table.Group(#"Changed Type", {"TrackingNumber"}, {{"MinDurationRow", each Table.FirstN(Table.Sort(_,{{"Duration", Order.Ascending}}),1), type any }})

    Regards,
    Community Support Team _ Jing Zhang
    If this post helps, please Accept it as the solution to help other members find it.