Forum Discussion
Dataflow Incremental Refresh Detect Data Changes
Hi brandonyeo Power BI Gen1 Dataflows don’t let you modify the Canary function used for detecting changes. It always uses the full query, so performance gains are limited in complex cases. To optimize, create a lightweight SQL view or staging dataflow with just primary key and MODIFIED\_DATE. You can also consider using Gen2 Dataflows for better incremental refresh control.
You may be better off using manual refreshes of the older partitions via the XMLA endpoint ( ie by recreating the canary function in a more economical way).
Hi lbendlin, thanks for the tip. Correct me if I'm wrong, but I don't think XMLA endpoint can be set up for dataflows? Most of the info I can find about this topic is on semantic models. The table in this dataflow gets used as a standard fact table across several reports, so I would prefer for it to be set up in a dataflow.
You are right, at the moment the XMLA based control only works for semantic models. If this is important to you please consider voting for an existing idea or raising a new one at https://ideas.fabric.microsoft.com