singhs8's avatar
singhs8
New Member
1 day ago
Status:
New

Run OnDemand Fabric Data Pipeline with Runtime Parameters using REST API

Currently, Microsoft Fabric Data Pipelines can be triggered on demand, but there is no native capability to pass runtime parameter values when initiating a pipeline execution through REST APIs. This limitation reduces flexibility for automation, orchestration, and operational support scenarios. FYR - Background Jobs - Run On Demand Execute - REST API (DataPipeline) | Microsoft Learn

Problem Statement

Many enterprise data integration workloads require dynamic values to be supplied at runtime, such as:

  • Processing a specific business date
  • Running selective backfills
  • Environment-specific executions
  • Customer- or region-specific processing
  • Triggering pipelines from external applications
  • CI/CD and DevOps automation workflows

Without runtime parameter support, organizations must create workarounds such as configuration tables, temporary files, or multiple copies of the same pipeline, adding complexity and maintenance overhead.

Proposed Enhancement

Enhance Fabric Data Pipeline REST APIs to allow:

  1. Triggering a pipeline run with runtime parameter values.
  2. Overriding default pipeline parameters at execution time.
  3. Passing multiple parameter types:
    • String
    • Integer
    • Boolean
    • Decimal
    • Date/DateTime
    • Array/Object
  4. Viewing submitted parameter values in monitoring and run history.
  5. Invoking pipelines from external applications, Azure Functions, Logic Apps, Power Automate, and DevOps pipelines with custom parameter payloads.

Please consider adding support for runtime parameter injection when triggering Fabric Data Pipelines through REST APIs. This capability is critical for enterprise automation and large-scale operational workloads.

Recent ideas