Forum Discussion
Dataflow incremental load behaviour
Hello, I am working on a requirement to snapshot some data ona weekly basis for Power BI usage. I tried a solution using Incremental load I have a query with the following logic: Select ItemCa...
I think this documentation explains it pretty well.
I did read the documentation, from my understanding, when my second reload takes place, the data from my first reload should be in partitions between the rolling window tail and the incremental tail, and thus, not affected by the reload. I do not understand why this data is affected and replaced on later reloads
It may be impacted because the actual partitions are controlled by the Azure service and they are set to "normal" calendar boundaries - days, months, quarters, years. Note that there are no weeks!
So if your incremental window is "two weeks" today it will impact four day partitions and one month partition.