Enable to pass variables from pipelines as parameters into a Dataflow Gen2

[#1]

Enable to modify the mashup document of a Dataflow Gen2 by passing a variable from a pipeline before an execution of the Dataflow

[rpaskarathas]

Looking forward to using it as this will make dataflows gen2 more dynamic.

[Ramunas_Guobys]

I think its the most important functionality for pipelines.

[fbcideas_migusr]

Hi,

I hope that a such feature could be released as soon as possible. Thanks

[RRogers1]

Planned for the first half of Calendar year 2024

LOL

Where is it?

[Amila2]

This is an essential feature and hope will be available soon. Workarounds are not that elegant.

[rvp1]

I just noticed that the backend for this feature seems to exist already. When starting a dataflow from a pipeline, defined parameters show as input in the pipeline monitor. I have trouble understanding just why passing parameters would be more difficult to implement.

[mdelpapa]

Honestly, the fact that you can plop a Dataflow Gen2 into a pipeline and connect it to activities is a complete joke since you are unable to pass output, parameters, or variables. A random dataflow sitting in the middle of your pipeline but not talking in any way to the other activities. Yay! PowerQuery is touted for being able to connect to over 300 different sources, but none of those are Pipeline objects? What genius at Microsoft thought that would get any traction? How dumb do they think PowerBI users are?

Instead, I see most users bypassing Dataflows altogether in favor of Notebooks, and now I can see why. This needs to be fixed pronto because I can't see too many organizations willing to sign up for Fabric if they still need to deploy code-based solutions for their ETL inside Fabric.

PowerQuery in Azure Data Factory? Who cares? It doesn't work. If you need to do complex transformations of your data, Notebooks IS THE ONLY SOLUTION.

[nishalit]

This is currently in planning. Be sure to check out the release plan for timelines around this feature once they become available:

What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

[Lackshu_Balasub]

I don't see it in the release plan link. Do we have a general timeline?

[John_Lundell]

This will be very useful. Would love to be able to pass based on conditions like using date time etc.