Forum Discussion

LouisPaulVlx's avatar
LouisPaulVlx
New Member
10 months ago
Solved

Simplify and improve visualisation for variable library importation within pipeline

Hi,    One idea would be to simplify the importation of variables from a variable library inside a pipeline.    Current state is when we add a variable from a library variable, we can only add on...
Data Pipeline
  • tayloramy's avatar
    tayloramy
    10 months ago

    Hi LouisPaulVlx, 

     

    As AntoineW stated,  

    Today the pipeline UI only lets you link library variables one at a time, and there is no grouping in the Variables pane. That is expected for the current preview.

    To avoid the 40-click setup, I’d switch from “many variables per source” to a single config per source and parse it inside the pipeline: Put one JSON string per source in the Variable Library,

    e.g. SRC_A_Config = {"Server":"...","Db":"...","Table":"...","Key":"..."}.

    In your activity settings, read fields with the expression builder, for example: @json(pipeline().libraryVariables.SRC_A_Config).

    This reduces each source from 10 linked variables to exactly 1, while still letting you parameterize everything. Variable Libraries and pipeline integration are documented here: Variable library integration with Data pipelines and the Variable Library overview/get-started docs here: Overview, Get started

    If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.