Forum Discussion
change a parameter value defined in a dataflow in a data pipeline
Hello
i have a question about a data pipeline that call a dafaflow gen 2 in microsoft fabric
My dataflow gen 2 has a date paremeter , i fixed a default value
i would when i execute the data pipeline i want to change the value defined in the parameter
I try with a variable and set variable : but no effects , i run with the default value
have a solution to do this ?
thanks
Hi ludovicLaurent ,
As NandanHegde said, when you want to make changes to a parameter that has been defined by default, the system won't allow it. Because it's written with an underlying structure that doesn't support such operations.
But I think you can use pipeline variables or expressions to set parameter values dynamically instead of using fixed values. If you want to use variables, make sure that you have a "Set Variable" activity before the "Execute Data Flow" activity. In the Parameters tab of the Execute Data Flow activity, set the parameter value to the variable you defined.You can also refer to the following document for more information: Parameterizing mapping data flows - Azure Data Factory & Azure Synapse | Microsoft Learn
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Perhaps as a workaround you can store the date parameter in a Lakehouse (e.g. as a cell value in a table), and have the Dataflow Gen2 read the date value from the Lakehouse table.
Then, if you update the date value in the Lakehouse table, it should get updated in the Dataflow Gen2 also.
Here is a forum thread which tells that passing parameters directly from Data pipeline to Dataflow Gen2 is not possible. https://community.fabric.microsoft.com/t5/Data-Pipelines/Pass-data-pipeline-parameter-to-dataflow-gen2/m-p/3264346
You can also vote for this Idea to increase the priority of implementing this functionality:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602
5 Replies
Hi ludovicLaurent ,
As NandanHegde said, when you want to make changes to a parameter that has been defined by default, the system won't allow it. Because it's written with an underlying structure that doesn't support such operations.
But I think you can use pipeline variables or expressions to set parameter values dynamically instead of using fixed values. If you want to use variables, make sure that you have a "Set Variable" activity before the "Execute Data Flow" activity. In the Parameters tab of the Execute Data Flow activity, set the parameter value to the variable you defined.You can also refer to the following document for more information: Parameterizing mapping data flows - Azure Data Factory & Azure Synapse | Microsoft Learn
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Perhaps as a workaround you can store the date parameter in a Lakehouse (e.g. as a cell value in a table), and have the Dataflow Gen2 read the date value from the Lakehouse table.
Then, if you update the date value in the Lakehouse table, it should get updated in the Dataflow Gen2 also.
Here is a forum thread which tells that passing parameters directly from Data pipeline to Dataflow Gen2 is not possible. https://community.fabric.microsoft.com/t5/Data-Pipelines/Pass-data-pipeline-parameter-to-dataflow-gen2/m-p/3264346
You can also vote for this Idea to increase the priority of implementing this functionality:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602
Based on my understanding, as of now the Dataflow Gen 2 cannot be parameterized at rune time via data pipelines. So it would be hardcoded version itself
Hello
what do you mean with "hardcoded version itself"
Do you mean to change the json generated by the pipeline ? I try some change but with no effect
thanksHi ludovicLaurent ,
Have you solved your problem? If so, can you share your solution here and mark the correct answer as a standard answer to help other members find it faster? Thank you very much for your kind cooperation!
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
