Query regarding 'Detect data changes' option for Incremental Refresh

[davidismaeloch]

Hi everyone!
I have multiple dataflows in Premium capacity because we are looking to reduce the refresh time as much as possible, I turned on the Incremental refresh for most of the tables and I included the option of "Detect data changes"....
After setting the incremental refresh, the refresh history has been showing the same time they took prior to the incremental refresh or in some cases even more time 😞
Is it really worthy the incremental refresh with detect data changes option?

[audreygerred]

Hello - have you ensured that query folding did not break due to one of your applied steps in Power Query? With Detect data changes, if you have it set to incrementally refresh the last two weeks of data it will only actually refresh anything new and anything in the last two weeks that has changed instead of the entire two weeks. 

[davidismaeloch]

Hi @audreygerred 
how can I tell if one of the applied steps is causing this query folding to break?
thank you a lot!

[audreygerred]

Right click on the step in Applied Steps and see is View native query is greyed out on any of them.

[davidismaeloch]

I think they changed the naming of 'View native query', is it the same as 'View data source query'?

[audreygerred]

Yup! That's it! 

Here are some additional resources regarding query folding: 

http://powerbiwithme.com/2023/09/21/the-query-folding-edition/ 

Query folding - Power Query | Microsoft Learn

Incremental refresh & query folding | Microsoft Power BI Blog | Microsoft Power BI

[davidismaeloch]

If even the source step is not query-folding compatible, does that mean that the source (Odata) for this project doesn't allow query folding and it is better for this case to turn off the incremental refresh? 

Thank you a lot for your answers

[audreygerred · Accepted solution]

OData and OData Feed generally do support query folding: https://learn.microsoft.com/en-us/power-query/power-query-folding#sources-that-support-folding