Forum Discussion
Dataflows Incremental and Full Refresh
I have a dataflow that contains data for the past 8 years. Most of the changes to that data are additions that would include a current date in the date column, so an incremental refresh process would...
What you need is differential refresh, not incremental refresh. You need to severely rethink your strategy, since incremental refresh is fundamentally based on the assumption that "cold storage" partitions are no longer modified.
I recommend you re-read this article. Using incremental refresh with dataflows | Microsoft Docs It's actually pretty good (albeit disappointing).