Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes! Register now.

Simplify and improve visualisation for variable library importation within pipeline

Hi, 

 

One idea would be to simplify the importation of variables from a variable library inside a pipeline. 

 

Current state is when we add a variable from a library variable, we can only add once at a time. 

If we have 4 variables libraries to import with 10 variables inside, we need to repeat this option 40 times. It can lead to human misclick. 

 

Second improvment : When we have added all those variables it looks a bit messy in the library variables pane with lot of variables (1variable = 1 line). Maybe we can group them by variables libraries there ? Or find a way to make it more visual ? 

Context: 
I'm having a pipeline orchestrator, which is runing another pipeline 4 times to ingest data from 4 different datasources. The 4 uses the exact same pipeline, only changing the parameters with the library variables. I have 10 parameters for each libraries, which lead me to import 40 variables in the orchestrator to make it work. Tomorrow, I can add new sources again, and it would increase everytime by 10 the number of variables from libraries I need to import. Hence the difficulty with managing so many variables from the current library variables pane. 

Thanks for reading!

Status: New
Comments
frithjof_v
Super User
Current workaround for adding multiple at one time is to use the Edit JSON of the data pipeline