Forum Discussion

nikhil_fsoft's avatar
nikhil_fsoft
Advocate I
5 years ago
Solved

Incremental Dataflow

I want to understand if my Dataflow refreshes incrementally then all datasets built on top of it are also incremental or they will do full refresh.

Need Help
Tips and Tricks
  • jeffshieldsdev's avatar
    jeffshieldsdev
    5 years ago

    Unless you also have incremental refresh set on your dataset, then it will do a full load. Incremental refresh against non-foldable sources isn't recommended; Power Query will still have to load the full dataflow entity to figure out which dates to import.

3 Replies

  • jeffshieldsdev's avatar
    jeffshieldsdev
    Solution Sage
    5 years ago

    Unless you also have incremental refresh set on your dataset, then it will do a full load. Incremental refresh against non-foldable sources isn't recommended; Power Query will still have to load the full dataflow entity to figure out which dates to import.

    • dkangel21's avatar
      dkangel21
      Frequent Visitor
      5 years ago

      To be clear - are you saying that the first time you do a refresh - even if it is configured for incremental - a Full refresh occurs regardless?  I am hoping this is the case because it saves us a lot of headache if it works this way.  Please confirm.  I cannot find documentation indicating this is how it works - if you have a link stating this it would be greatly appreciated.