Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
Nozama
Helper I
Helper I

Query on removing duplicates

I have a table like so: 

Nozama_0-1740504002901.png

I would like to remove duplicate rows such that I only keep the document which has the highest revision. Any help is appreciated. Result: 

Nozama_1-1740504201337.png

Thank you.

1 ACCEPTED SOLUTION
dufoq3
Super User
Super User

Hi @Nozama, check this:

 

Output

dufoq3_0-1740593949832.png

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMgIBJR0lQ6VYnWglQxAA8ozAPJicEYqcMYqcCZhnDAIYPFMUfWYochZKsbEA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Document = _t, Revision = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Revision", Int64.Type}}),
    KeepMaxRevisionRow = Table.Combine(Table.Group(ChangedType, {"Document"}, {{"T", each Table.MaxN(_, {"Revision"}, 1), type table}})[T])
in
    KeepMaxRevisionRow

Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

View solution in original post

3 REPLIES 3
dufoq3
Super User
Super User

Hi @Nozama, check this:

 

Output

dufoq3_0-1740593949832.png

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMgIBJR0lQ6VYnWglQxAA8ozAPJicEYqcMYqcCZhnDAIYPFMUfWYochZKsbEA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Document = _t, Revision = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Revision", Int64.Type}}),
    KeepMaxRevisionRow = Table.Combine(Table.Group(ChangedType, {"Document"}, {{"T", each Table.MaxN(_, {"Revision"}, 1), type table}})[T])
in
    KeepMaxRevisionRow

Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

Akash_Varuna
Super User
Super User

Hi @Nozama Ypu could achive this by Group By Please try this

  • Select the Document column.
  • Click Home > Group By.
  • In the Group By dialog:
    • Set "Group By" to Document.
    • Add an aggregation operation for Revision with Max.
      If this post helped plpease do give a kudos and accept this as a solution
      Thanks In Advance

 

 

Thanks for that. I think it worked (sort of). I added the step but the result got rid of all the other columns in the table!

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.