Implementing Incremental refresh in Dataflow gen 2

[Ar_Sh]

I am facing an while implementing Incremental refresh in Dataflow gen 2, but when loading the data in the destination I am getting only the data from the year range I have selected for the incremental. I am looking for any advise on this.. why this is happeing

[Shubham_rai955 · Accepted solution]

This is actually the expected behavior of Incremental Refresh in Dataflow Gen2. When you configure incremental refresh, Power BI only loads and processes data within the defined range you set for refresh (for example, the last 2 years or last 12 months).

The older data outside that range is not reloaded or refreshed automatically, it remains stored in the existing dataset. So, when you load the destination table, you’ll only see data for the period defined in your incremental refresh policy.

If you want the full dataset, you’ll need to perform a one-time full refresh or adjust your range settings. Incremental refresh is designed to optimize performance by processing only the most recent data, not the entire history.

[Ar_Sh]

Yes I am seeing the same behaviour

[Rufyda]

Did you find a solution to the issue?

[vojtechsima]

Hey, @Ar_Sh ,

Check out this article. What you're trying to do should be possible:
https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-incremental-refresh

In general, you always get the data for the range you chose, so I am not sure whether you mean that you get data rewritten by the "Fresh" range, because any data outside the selected range won't be present.

I would try first loading full table and only after that set up the incremental refresh.