Forum Discussion
gigotomo
5 years agoFrequent Visitor
How to remove duplicates based on latest dates
I am trying to remove the duplicate "INC_NUM" and only the latest date (Submit) should remain alongwith its summary. How do i do it.
- 5 years ago
gigotomo
Here is one way to do this- Open Power Query Editor
- Duplicate this table in PowerQuery
- delete summary column from new table
- Right click on INC_Num and select Group by
- In Group By pop up box give New Column Name the value "Submit", set operation to "MAX", and select Submit under Column. Click OK
- Duplicate INC_Num & Submit columns
- Duplicate INC_num column & Submit column in current Table
- select both "Inc_num - Copy" & "Submit - Copy", right click, and select Merge Columns.
- Click OK in Merge Column popup box
- Return to the original table and repeat steps 6 - 8
- Now you have a shared Key you can Merge Queries together. From the Original Table click on "Merge Queries" in the top Home Ribbon
- The top query will be your Original Table and you need to select the new aggregated table as the second table. Then click on the merged column in each table as your join column. Under Join Kind select "Inner (Only matching rows)
- That's it. This will have only grabbed the INC_Num with the last date.
- 5 years ago
gigotomo ,
Please refer the below thread to achieve your need.
https://community.powerbi.com/t5/Desktop/Drop-duplicate-rows-retaining-latest-date/m-p/878537
IDoLogistics
3 years agoAdvocate I
Hi All,
I know this has already been answered, but it looks like Pragmatic Works has a more simple soloution to the problem involving "Table.Buffer".
https://www.google.com/search?q=power+query+how+to+sort+by+newest+date+then+remove+older+duplicates&rlz=1C1GCEB_enUS1001US1001&oq=power+query+how+to+sort+by+newest+date+then+remove+older+duplicates&aqs=chrome..69i57.35026j1j7&sourceid=chrome&ie=UTF-8#fpstate=ive&vld=cid:ee78921d,vid:S3X_HK7yl1w
sebastianrizzo
2 years agoRegular Visitor
This worked for me also!