Hi, @Dhairya
Currently, the incremental refresh function has not been launched in Dataflow Gen2. You can click on the link below to learn about the features supported by Dataflow Gen2 and Dataflow Gen1:
https://learn.microsoft.com/en-us/fabric/data-factory/dataflows-gen2-overview
Pattern to incrementally amass data with Dataflow Gen2. Accumulating data incrementally in a data target requires a technique of loading only new or updated data into the data target. This technique can be done by using queries to filter data based on data targets. This is different from incremental refresh. Incremental refresh is a feature currently under development. This feature is one of the most voted ideas on our creative site. You can vote for this feature on the Fabric Ideas website. The following are the main steps to configure this mode:
1.Create a dataflow to load data from an OData source into a lakehouse
2.Add a query to the dataflow to filter the data based on the data destination
3.(Optional) reload data using notebooks and pipelines
You can click on the link below to learn more about how to configure this mode:
https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-setup-incremental-refresh-with-datafl...
Here are some links that may be helpful to you:
Parquet, ADLS Gen2, ETL, and Incremental Refresh in one Power BI Dataset | by Nolock | Medium
Using incremental refresh with dataflows - Power Query | Microsoft Learn
Cases with the same questions: Solved: Re: Dataflow Gen 2 - Incremental refresh? - Microsoft Fabric Community
How to Get Your Question Answered Quickly
Best Regards
Jianpeng Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi, @Dhairya
Currently, the incremental refresh function has not been launched in Dataflow Gen2. You can click on the link below to learn about the features supported by Dataflow Gen2 and Dataflow Gen1:
https://learn.microsoft.com/en-us/fabric/data-factory/dataflows-gen2-overview
Pattern to incrementally amass data with Dataflow Gen2. Accumulating data incrementally in a data target requires a technique of loading only new or updated data into the data target. This technique can be done by using queries to filter data based on data targets. This is different from incremental refresh. Incremental refresh is a feature currently under development. This feature is one of the most voted ideas on our creative site. You can vote for this feature on the Fabric Ideas website. The following are the main steps to configure this mode:
1.Create a dataflow to load data from an OData source into a lakehouse
2.Add a query to the dataflow to filter the data based on the data destination
3.(Optional) reload data using notebooks and pipelines
You can click on the link below to learn more about how to configure this mode:
https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-setup-incremental-refresh-with-datafl...
Here are some links that may be helpful to you:
Parquet, ADLS Gen2, ETL, and Incremental Refresh in one Power BI Dataset | by Nolock | Medium
Using incremental refresh with dataflows - Power Query | Microsoft Learn
Cases with the same questions: Solved: Re: Dataflow Gen 2 - Incremental refresh? - Microsoft Fabric Community
How to Get Your Question Answered Quickly
Best Regards
Jianpeng Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Helpful resources
Fabric Community Update - November 2024
Find out what's new and trending in the Fabric Community.
Be one of the first to start using Fabric Databases
Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.
Join us at the Microsoft Fabric Community Conference
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.
Power BI Monthly Update - November 2024
Check out the November 2024 Power BI update to learn about new features.
