Forum Discussion
Remove duplicates without breaking query folding?
Is there a way to remove duplicates without breaking query folding? I need the folding (for incremental refresh), but I have a ton of duplicates (I go from 3 0378 271 rows to 10 472 after removing du...
Hi V-lianl-msft thanks for the reply...
Your answer would make sense if I had actually set ranges, but I haven't gotten to setting the ranges yet, because query folding on my dataset breaks. The final step in my query (remove duplicates) breaks the folding.
So my question is, how can I remove the duplicates without breaking the folding?
I could use this as well, did you ever find out how to do this?
Table.Distinct() breaks the fold. How do we tell the servers to return a distinct list after all our previous steps?
Never mind. Table.Distinct() only breaks the fold if you use it to remove duplicates from a subset of the tables columns, instead of the whole table. Using Table.Distinct() on the entire table does not break the query folding.