Forum Discussion

brandonyeo's avatar
brandonyeo
Frequent Visitor
1 year ago
Solved

Dataflow Incremental Refresh Detect Data Changes

Hi,   I'm trying to set up incremental refresh for a Gen1 Dataflow in PBI Service that queries an Oracle database. The SQL query is rather complex with several joins and nested CTE that would resu...
Dataflow
Need Help
  • Akash_Varuna's avatar
    Akash_Varuna
    1 year ago

    Hi brandonyeo Power BI Gen1 Dataflows don’t let you modify the Canary function used for detecting changes. It always uses the full query, so performance gains are limited in complex cases. To optimize, create a lightweight SQL view or staging dataflow with just primary key and MODIFIED\_DATE. You can also consider using Gen2 Dataflows for better incremental refresh control.

Akash_Varuna's avatar
Akash_Varuna
Super User
1 year ago

Hi brandonyeo Power BI Gen1 Dataflows don’t let you modify the Canary function used for detecting changes. It always uses the full query, so performance gains are limited in complex cases. To optimize, create a lightweight SQL view or staging dataflow with just primary key and MODIFIED\_DATE. You can also consider using Gen2 Dataflows for better incremental refresh control.

lbendlin's avatar
lbendlin
Super User
1 year ago
You can also consider using Gen2 Dataflows for better incremental refresh control.

Do you have a reference for this?