Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Request now

Reply
Nozama
Helper I
Helper I

Query on removing duplicates

I have a table like so: 

Nozama_0-1740504002901.png

I would like to remove duplicate rows such that I only keep the document which has the highest revision. Any help is appreciated. Result: 

Nozama_1-1740504201337.png

Thank you.

1 ACCEPTED SOLUTION
dufoq3
Super User
Super User

Hi @Nozama, check this:

 

Output

dufoq3_0-1740593949832.png

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMgIBJR0lQ6VYnWglQxAA8ozAPJicEYqcMYqcCZhnDAIYPFMUfWYochZKsbEA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Document = _t, Revision = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Revision", Int64.Type}}),
    KeepMaxRevisionRow = Table.Combine(Table.Group(ChangedType, {"Document"}, {{"T", each Table.MaxN(_, {"Revision"}, 1), type table}})[T])
in
    KeepMaxRevisionRow

Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

View solution in original post

3 REPLIES 3
dufoq3
Super User
Super User

Hi @Nozama, check this:

 

Output

dufoq3_0-1740593949832.png

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMgIBJR0lQ6VYnWglQxAA8ozAPJicEYqcMYqcCZhnDAIYPFMUfWYochZKsbEA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Document = _t, Revision = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Revision", Int64.Type}}),
    KeepMaxRevisionRow = Table.Combine(Table.Group(ChangedType, {"Document"}, {{"T", each Table.MaxN(_, {"Revision"}, 1), type table}})[T])
in
    KeepMaxRevisionRow

Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

Akash_Varuna
Super User
Super User

Hi @Nozama Ypu could achive this by Group By Please try this

  • Select the Document column.
  • Click Home > Group By.
  • In the Group By dialog:
    • Set "Group By" to Document.
    • Add an aggregation operation for Revision with Max.
      If this post helped plpease do give a kudos and accept this as a solution
      Thanks In Advance

 

 

Thanks for that. I think it worked (sort of). I added the step but the result got rid of all the other columns in the table!

Helpful resources

Announcements
November Power BI Update Carousel

Power BI Monthly Update - November 2025

Check out the November 2025 Power BI update to learn about new features.

Fabric Data Days Carousel

Fabric Data Days

Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.