Forum Discussion
Incremental Refresh Steps are not Folding
I have a dataflow doing a select from a single sql server table, however when i apply incremental refresh the step to apply this is being applied outside the data source why? The timestamp field on the table uses the DATETIMEFROMPARTS function but the timestamp column in the sql server database is type datetime2. I am just trying to improve perfomance of the table as it has over 100 milion rows so any help would be greatly appreciated
2 Replies
Hi. I think by default the query folding is disabled for native queries. However you can activate it like the following doc is showing:
https://docs.microsoft.com/en-us/power-query/native-query-folding?WT.mc_id=M365-MVP-5004778I hope that helps,
Thanks for this, i was able to implement and the incremental refresh now folds. I just wanted to check is my understanding correct. If the query does not fully fold when incremenatl refresh is on the data has to be cached on the gateway server. If there is not enough memory on the server the refresh will fail. The 2 options are either get the query to fold full using native query so incremental refresh folds or increase the memory on the gateway server so that it can cache while refresh runs?
