How will Dataflow Gen 2 Store data at a destination?

[Dhairya]

While creating the Dataflow Gen 2 I specified the destination and published the dataflow once. After that if I refresh the dataflow then how will it update the data in the destination? i.e., will it append the data, truncate, and reload the whole data or it will incrementally refreshes the data?

[Anonymous · Accepted solution]

Hi @Dhairya ,

There are two types of refreshes applicable to dataflows:

• Full, which performs a complete flush and reload of your data.

• Incremental (Premium only), which processes a subset of your data based on time-based rules, expressed as a filter, that you configure. The filter on the date column dynamically partitions the data into ranges in the Power BI service. After you configure the incremental refresh, the dataflow automatically alters your query to include filtering by date. You can edit the automatically generated query by using the Advanced Editor in Power Query to fine-tune or customize your refresh. If you bring your own Azure Data Lake Storage, you can see time slices of your data based on the refresh policy you've set.

More details: Understand and optimize dataflows refresh - Power BI | Microsoft Learn

How to Get Your Question Answered Quickly 

If it does not help, please provide more details.

Best Regards
Community Support Team _ Rongtie

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[aj1973]

Hi @Dhairya 

If you you don't set up an incremental refresh to you table then it want incrementally refresh the data. So yes it wil reload the whole data.