Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

View Dataflow parameters from pipeline when Workspace and Dataflow values are parameterized

I am following the documentation at https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-parameterized-dataflow to parameterize my dataflow and pass in the parameters from my variable library. I am able to pass the parameters to the dataflow from the pipeline to the dataflow but once I try to parameterize the workspace id and dataflow id in the pipeline, the dataflow parameters option disappears.

 

I've found a temporary workaround by saving it both ways and then manually merging the source file, but every time I open the pipeline to make edits, any saves overwrite my work around.

 

Can the UI be updated to show the dataflow parameters when variables are used for the dataflow?

 

Passing Parameterized values to the dataflow: 

 
 

terra8191_4-1760369328396.png

 

 

parameterizing the dataflow connection breaks/hides the ability to pass the parameters to the dataflow:

 

terra8191_5-1760369341076.png

 

 

Manually edited pipeline-content.json:

 

terra8191_6-1760369351889.png

 

Status: Planned

We're working on this. At the moment, if you parameterize the Dataflow ID or the WorkspaceID then the script created will only run against Dataflow Gen2 and not Dataflow Gen2 (with CI/CD) which uses a different API. This is documented in the article below:

Dataflow activity - Microsoft Fabric | Microsoft Learn

miguel_0-1760391112213.png

Once that limitation is lifted, things will work as you've mentioned and this is a quick preview on how that would look like:

miguel_1-1760391335385.png

 

 

Comments
miguel
Community Admin
Status changed to: Planned

We're working on this. At the moment, if you parameterize the Dataflow ID or the WorkspaceID then the script created will only run against Dataflow Gen2 and not Dataflow Gen2 (with CI/CD) which uses a different API. This is documented in the article below:

Dataflow activity - Microsoft Fabric | Microsoft Learn

miguel_0-1760391112213.png

Once that limitation is lifted, things will work as you've mentioned and this is a quick preview on how that would look like:

miguel_1-1760391335385.png