Run OnDemand Fabric Data Pipeline with Runtime Parameters using REST API
Currently, Microsoft Fabric Data Pipelines can be triggered on demand, but there is no native capability to pass runtime parameter values when initiating a pipeline execution through REST APIs. This limitation reduces flexibility for automation, orchestration, and operational support scenarios. FYR - Background Jobs - Run On Demand Execute - REST API (DataPipeline) | Microsoft Learn
Problem Statement
Many enterprise data integration workloads require dynamic values to be supplied at runtime, such as:
- Processing a specific business date
- Running selective backfills
- Environment-specific executions
- Customer- or region-specific processing
- Triggering pipelines from external applications
- CI/CD and DevOps automation workflows
Without runtime parameter support, organizations must create workarounds such as configuration tables, temporary files, or multiple copies of the same pipeline, adding complexity and maintenance overhead.
Proposed Enhancement
Enhance Fabric Data Pipeline REST APIs to allow:
- Triggering a pipeline run with runtime parameter values.
- Overriding default pipeline parameters at execution time.
- Passing multiple parameter types:
- String
- Integer
- Boolean
- Decimal
- Date/DateTime
- Array/Object
- Viewing submitted parameter values in monitoring and run history.
- Invoking pipelines from external applications, Azure Functions, Logic Apps, Power Automate, and DevOps pipelines with custom parameter payloads.
Please consider adding support for runtime parameter injection when triggering Fabric Data Pipelines through REST APIs. This capability is critical for enterprise automation and large-scale operational workloads.
2 Comments
Found the Solution
POST : https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/items/{itemId}/jobs/Pipeline/instances
Body: {"executionData": {"parameters": { "config_file": "active"} } }
Recent ideas
Control Schedule Activation per Environment in Deployment Pipelines
Currently, with the new multiple scheduler feature, we can define multiple run schedules for a Fabric item. However, when using deployment pipelines, there’s no way to control which schedules are act...frithjof_v56 minutes agoCommunity ChampionPlanned5.6KViews64likes10CommentsLet Workspace Admins manage Fabric Policies
For example, allow a Workspace Admin to grant other identities the Contributor role, while also granting them higher privileges in certain areas, e.g. List Workspace role permissions (without resha...frithjof_v3 hours agoCommunity ChampionNew44Views0likes3CommentsSupport Fabric SQL Database with workspace-level inbound Private Link
Fabric SQL Database supports tenant-level Private Link but not workspace-level Private Link. Securing a small number of databases therefore requires enabling Private Link across the entire tenant, in...WorkFull224 hours agoAdvocate INew49Views1like3CommentsShow Refreshing indicator in workspace for semantic model refreshes from pipelines and XMLA
When I start a semantic model refresh by hand ("Refresh now") or from a schedule, the workspace list shows a spinning refresh icon next to the model. That way, anyone can see a refresh is running. T...JDownes7 hours agoRegular VisitorNew11Views0likes0CommentsREST API - exclude hidden report pages
For the "Reports - Get Pages" REST API call, exclude hidden report pages or indicate that the page is hidden.alec_johnson8 hours agoNew MemberNeeds Votes652Views32likes10Comments