Forum Discussion
MYSQL -- DISTINCT clause in sql query
Table.Distinct or Table.Group can work around that date column (by not including it in either command).
You will have to check the performance. Ideally your Power Query transforms "fold" (can be converted back into SQL and pushed up into the data source).
You can use Table.Distinct() without specifying any column, with specifying all columns, or with specifying some columns. (The latter will produce random results).
Trying to deduplicate 44M rows in Power Query is ambitious. It will take a very long time.
can't do it in the DBPlease elaborate.
Thank you for your response,
Improving performance in refresh is what I am trying to achieve. I thought that deduplicating in the first step would be better than add another step of Table.Distinct()
Please elaborate.
Database table has a date column that cannot be removed, that column makes the duplicates to not being duplicates, but since I don't need that date column the rows are duplicate.
Table.Distinct or Table.Group can work around that date column (by not including it in either command).
You will have to check the performance. Ideally your Power Query transforms "fold" (can be converted back into SQL and pushed up into the data source).
Table.Distinct or Table.Group can work around that date column (by not including it in either command).
You will have to check the performance. Ideally your Power Query transforms "fold" (can be converted back into SQL and pushed up into the data source).