Forum Discussion

julsr's avatar
julsr
Continued Contributor
7 months ago
Solved

Dataflow incremental refresh duplicates data

Hello everyone!   I have several Dataflows Gen 1 in my workspace. These dataflows contain data from multiple years, and I refresh them daily. However, I am using Incremental Refresh settings to upd...
  • lbendlin's avatar
    lbendlin
    7 months ago
     If that's the case, how does Power BI know which records need to be updated?

    It's called incremental refresh, not differential refresh. 

     

    Incremental refresh CANNOT update records. The best you can do is flush and fill partitions.

     

    You could use the "Detect data changes"  option but what this will do is create a shadow copy ("canary") of your semantic model, effectively doubling the storage needs.

     

    In essence - it is YOU who needs to know which rows have changed, and who has to decide if and when to refresh the impacted partitions.