How to setup incremental refresh for fabric dataflows gen2

[pavannarani]

Hello People,

Is there a way to setup the incremental refresh in fabric dataflows gen2.

Regards

Pavan kumar

[pallavi_r]

Hi @pavannarani ,

Please check this microsoft link on incrementally refreshing in dataflow gen 2. Please see if this answers your query.

https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-setup-incremental-refresh-with-datafl...

Thanks,

Pallavi

[pavannarani]

@pallavi_r Thanks for your reply,

link is talking about the OrderID column to fetch the incremental data but i want to pull data based on datetime column from source itself for any table

[v-linhuizh-msft · Accepted solution]

Thank pavannarani 

Hi, @pavannarani 

As you mentioned that you want to refresh by datetime column, you can refer to this official documentation below.
There are detailed steps on configuring incremental refresh for datastreams in the following official document:

Using incremental refresh with dataflows - Power Query | Microsoft Learn

Incremental refresh in this mode requires that the source data introduced into the stream has a DateTime field that incremental refresh can filter. Incremental refresh is set at the table level, allowing a data stream to hold both a fully refreshed table and an incrementally refreshed table.

You can choose the incremental refresh method that suits you from the incremental refresh method and the current method in the link provided by pallavi_r.
Also, I found some blogs related to incremental refresh of data streams that you can use as a reference:

Load data incrementally from the source to the destination using Dataflow Gen2 : (substack.com)

Power BI dataflows: a Deep Dive into Incremental Refresh & the Enhanced Compute Engine (datalineo.co...

Incremental Refresh and Hybrid tables in Power BI: Load Changes Only - RADACAD

Best Regards,
Zhu
Community Support Team

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!