Duplicates

[Anonymous]

Hi i have a dataset with duplicates for multiple values and i want to remove duplicates for only one of the value.

for examples i have column where i have duplicates for 1,2,3 are want to remove duplicates of value 1 only not other values.

pl help.

[dufoq3]

Hi @Anonymous, you should provide sample data so we can copy/paste and expected result based on sample data. But the idea how to do that could be this:

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMlSK1YlWMgKThkgkRMQYScQYVWUsAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
    ChangedType = Table.TransformColumnTypes(Source,{{"Column1", Int64.Type}}),
    FilteredRowsDuplicatesToRemove = Table.SelectRows(ChangedType, each ([Column1] = 1)),
    RemovedDuplicates = Table.Distinct(FilteredRowsDuplicatesToRemove),
    StepBack = ChangedType,
    FilteredRowsDuplicatesToKeep = Table.SelectRows(StepBack, each ([Column1] <> 1)),
    Combined = RemovedDuplicates & FilteredRowsDuplicatesToKeep
in
    Combined

[Anonymous]

Hi,

is there any option if we want to keep the last appearance instead of first appearance of duplicate value?

[dufoq3]

Yes, but provide sample data as table so we can copy/paste.

[Anonymous]

what if the values that need to remove are text?

[dufoq3]

It doesn't matter. The logic is the same.