Remove duplicates bug

[anthonymachado]

I have a table of addresses and I want to run Remove Duplicates on the ID column:

If I filter for address 743786 afterwards, it doesn't appear.

However, if I filter the address before the dedupe, it shows that there is only one address with that ID, and the deduplication step leaves it alone:

Is this a bug?

[v-veshwara-msft]

Hi @anthonymachado ,

Just checking in to see if you query is resolved and if any responses were helpful.
Otherwise, feel free to reach out for further assistance.

Thank you.

[v-veshwara-msft]

Hi @anthonymachado ,

Thanks for reaching out to Microsoft Fabric Community.

Just wanted to check if the responses provided were helpful. If further assistance is needed, please reach out.
Thank you.

[MasonMA]

Hi, 

Power Query’s preview 1000 row limit will not cause Table.SelectRows to return an empty table.

Your 'ID' column has '1.2' icon, which means the column’s data type is Decimal Number (type number), not Whole Number, so even if every value looks like 743786, Power Query is treating it as a floating-point number.

My suggestion would be converting your data in 'ID' column to whole number type before having another try. 

[GeraldGEmerick · Accepted solution]

@anthonymachado Probably not a bug. Power Query Editor displays a preview of 1000 rows so for whatever reason the ID is in that 1000 row preview before the dedupe but not after it. Likely a sorting thing going on.