topic Re: Global Parameter in Data pipeline in Pipelines

Global Parameter in Data pipeline

AdarshPanasri — Tue, 06 Aug 2024 05:29:23 GMT

Hello Everyone, I am working with Data pipelines to automate the process to ingest data. I have multiple env which has env specific variables which will be used in my notebooks e.g. stg account name, container name, onelake container id, lakehouse id etc. I want to parameterize these values.

One way I thought was to use Global Parameters like in ADF, but it seems there is no such feature yet in Fabric, can someone please suggest a work around.

Note**

I am using absolute path in my code to get the tables or files from onelake and would want to parameterize those values as well.

Re: Global Parameter in Data pipeline

frithjof_v — Tue, 06 Aug 2024 06:37:56 GMT

Please vote on the Fabric Ideas site to highlight the need:

https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=8f170f19-d665-ed11-a76e-281878defc16

Please also search on the Fabric Ideas portal if you find any other Idea which you want to support, and vote for it to highlight it so the chance of it being implemented increases.

You can also submit a new idea if you don't find an existing idea which covers your need.

Re: Global Parameter in Data pipeline

NandanHegde — Tue, 06 Aug 2024 06:38:23 GMT

Unfortunately as you stated Global Parameters is not supported in MSFT Fabric data pipelines; so as an alternative you can have a config table/file that would have 2 columns :

ParameterName; ENvironment, Value

and accoridngly via lookup activity you can get the values for those configs at run time and pass them accordingly