Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago
Solved

Remove duplicates based on sort in Power Query

I have a table that has ID and date columns. I want to remove duplicates and only keep the most recent record for each ID. I thought I'd by able to simply by sorting either ascending or descending th...
  • AlexisOlson's avatar
    7 years ago

    I've run into this before. I think it's a result of query folding not operating in the order that you'd expect.

     

    The workaround that worked for me was to add an index column after sorting before removing duplicates. This breaks query folding and forces it to operate in the order you just defined by your sort.

  • AnkitBI's avatar
    AnkitBI
    7 years ago

    AlexisOlson  Anonymous

     

    Do check this video from curbal.com. It beautifully explains the reason why changing Sort Order in Power query doesn't work for removing duplicates and using Table.Buffer to keep new Sorting Order in memory.

     

    Curbal.com

     

    Sharing this as it might be helpful in some other scenarios too..