Forum Discussion

nikhil_fsoft's avatar
nikhil_fsoft
Advocate I
5 years ago
Solved

Incremental Dataflow

I want to understand if my Dataflow refreshes incrementally then all datasets built on top of it are also incremental or they will do full refresh.
Need Help
Tips and Tricks
  • jeffshieldsdev's avatar
    jeffshieldsdev
    5 years ago

    Unless you also have incremental refresh set on your dataset, then it will do a full load. Incremental refresh against non-foldable sources isn't recommended; Power Query will still have to load the full dataflow entity to figure out which dates to import.

jeffshieldsdev's avatar
jeffshieldsdev
Solution Sage
5 years ago

Unless you also have incremental refresh set on your dataset, then it will do a full load. Incremental refresh against non-foldable sources isn't recommended; Power Query will still have to load the full dataflow entity to figure out which dates to import.

  • nikhil_fsoft's avatar
    nikhil_fsoft
    Advocate I
    5 years ago

    Thanks. Really helpful

  • dkangel21's avatar
    dkangel21
    Frequent Visitor
    5 years ago

    To be clear - are you saying that the first time you do a refresh - even if it is configured for incremental - a Full refresh occurs regardless?  I am hoping this is the case because it saves us a lot of headache if it works this way.  Please confirm.  I cannot find documentation indicating this is how it works - if you have a link stating this it would be greatly appreciated.