Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Issue with parameterised Dataflow Gen2 activity

Problem Statement: A published Dataflow Gen2 that contains parameters is not exposing those parameters to the Dataflow Gen2 activity within a Fabric Pipeline. The pipeline editor shows 'This dataflo...
data engineering
data pipeline
  • v-aatheeque's avatar
    v-aatheeque
    1 year ago

    Hi Anonymous ,
    anon97242 wardy912  Thanks for your quick response , In addition to that ,

     

    • Parameters in Dataflow Gen2 are part of a preview feature called public parameters. This mode only works with dataflows that have CI/CD support enabled. If your dataflow isn’t set up this way, the parameters won’t be exposed to the pipeline.

    Reference : https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-parameters

    Hope this helps!!

    If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

    If you continue to face issues, feel free to reach out to us for further assistance!



wardy912's avatar
wardy912
Super User
1 year ago

I have faced this issue before and couldn't fix unfortunately, but as a workaround I used a notebook and I've never looked back.
With notebooks you can obtain a much more granular and deliberate set of data transformations.
You can also add base parameters to the notebook pipeline item which forces the pipeline to use it once referenced in your notebook, this is not available in dataflow gen2.
If notebooks are an option for you, I'd take that approach to avoid this issue.

 

 

To troubleshoot your dataflow gen2, even though your parameters are defined, make sure that the parameters are referenced in at least one of the queries, without this the pipeline may ignore it.