Issue with Parameter Refresh in Gen2 Dataflows in Microsoft Fabric

goldenarm253 — Wed, 28 Aug 2024 10:13:59 GMT

Hello everyone,

I’m currently working with Gen2 Dataflows in Microsoft Fabric, and I’ve encountered an issue related to parameter refresh that I hope someone can help clarify.

Issue Description:

I have successfully set up RangeStart and RangeEnd parameters in Power Query to enable incremental refresh.
In Gen1 Dataflows, I can see a dedicated Parameters section in the dataflow settings, allowing me to manage and refresh these parameters directly.
However, in Gen2 Dataflows, this Parameters section seems to be missing, and there is no visible way to refresh or manage parameters directly from the Dataflow settings.

Questions:

Has anyone else encountered this issue where the Gen2 Dataflows do not display the Parameters section for managing RangeStart and RangeEnd?
Is this a known limitation or a configuration issue that I need to address within Power Query or the Fabric workspace settings?
Are there any specific steps or workarounds to ensure that the parameters are refreshed correctly in Gen2 Dataflows?

Additional Context:

The refresh schedule is configured correctly, and the dataflow works without errors, but I’m concerned about the incremental refresh’s effectiveness without direct parameter management.
I have verified that the Fabric capacity settings support incremental refresh. (please correct me if I am wrong) 🙂

Any insights or guidance on how to resolve this would be greatly appreciated!

Thank you!

Re: Issue with Parameter Refresh in Gen2 Dataflows in Microsoft Fabric

LuitwielerMSFT — Wed, 28 Aug 2024 13:51:37 GMT

Hello!

My name is jeroen luitwieler and I am part of the PG for Dataflows. As of today we do not support incremental refresh for Dataflows Gen2. It is on our roadmap here: What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

In the meantime you can use this guide to incrementally amass data in your data destination: Pattern to incrementally amass data with Dataflow Gen2 - Microsoft Fabric | Microsoft Learn

So stay tuned for more updates on incremental refresh!

topic Issue with Parameter Refresh in Gen2 Dataflows in Microsoft Fabric in Dataflow

Issue with Parameter Refresh in Gen2 Dataflows in Microsoft Fabric

Issue Description:

Questions:

Additional Context:

Re: Issue with Parameter Refresh in Gen2 Dataflows in Microsoft Fabric