Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Duplicates

Hi i have a dataset with duplicates for multiple values and i want to remove duplicates for only one of the value. for examples i have column where i have duplicates for 1,2,3 are want to remove dup...
Need Help
dufoq3's avatar
dufoq3
Community Champion
2 years ago

Hi Anonymous, you should provide sample data so we can copy/paste and expected result based on sample data. But the idea how to do that could be this:

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMlSK1YlWMgKThkgkRMQYScQYVWUsAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Column1", Int64.Type}}),
    FilteredRowsDuplicatesToRemove = Table.SelectRows(ChangedType, each ([Column1] = 1)),
    RemovedDuplicates = Table.Distinct(FilteredRowsDuplicatesToRemove),
    StepBack = ChangedType,
    FilteredRowsDuplicatesToKeep = Table.SelectRows(StepBack, each ([Column1] <> 1)),
    Combined = RemovedDuplicates & FilteredRowsDuplicatesToKeep
in
    Combined