Parameters in Schedule Triggers of Fabric Data Pipeline

[DarshanBabar]

Hi,

Currently, we don't see any option to use Scheduled Triggers in Fabric Data Pipeline where we get an oprion of passing parameters.

Any update on this please.

Thanks,

Darshan

[jwinchell40]

@DarshanBabar - Why would you need to pass parameters to the pipeline as part of a schedule trigger?  I'm not saying it wouldn't be useful, just curious as to the use case.

In Fabric/Data Factory if we had a scheduled pipeline that required parameters we would read those values using a Lookup Step and drop them in variables.  For example, if we wanted to run the same pipeline for multiple customers the first step in our pipeline was getting our customer list + parameters for that customer.  Then we would use those values downstream.

The other option that worked really well for us with one of our Contact Center Dashboard products was using a "Trigger File" which is available in Fabric Pipelines and Data Factory.  The pipelines monitor a ADLS Gen2 folder and when a file is created it kicks off the pipeline.  You also are then able to read the contents of the file, pull out parameters or config settings and run the pipeline.

[SivaReddy24680]

Hi,

We have a scenario:

We have a config table in which we store the tables metadata of tables to extract from the source. We pass a parameter called BatchName on which we pull those batch tables especially.

Lets say if we have 10 tables, i need to run the 5 tables(BatchName=DailyBatch) in daily basis and 5 tables for every 2 hours(BatchName=HourlyBatch).

If I can have an option to pass parameters while scheduling the pipeline, It will be easy for me to schedule multiple schedules within the single pipeline. Else I may need to create separate pipeline for each batch

[Anonymous]

Hi @DarshanBabar ,

As of now, Microsoft Fabric Data Pipeline does not support passing parameters directly when using scheduled triggers. This feature is currently on the roadmap for future updates.

I think you can vote for this Idea under this link: Microsoft Idea

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.