Forum Discussion

Suryyyaaaa's avatar
Suryyyaaaa
Regular Visitor
1 year ago
Solved

How to Chain Multiple Pipelines Conditionally in Microsoft Fabric (Without Scheduling or File-Based

Hi Fabric Community, I’m working on a real-time orchestration scenario where I need to run multiple pipelines (e.g., Pipeline A → B → C) only if the previous one succeeds. If any pipeline fails, t...
data pipeline
  • v-nmadadi-msft's avatar
    v-nmadadi-msft
    1 year ago

    Hi  Suryyyaaaa ,
    Thanks for reaching out to the Microsoft fabric community forum.

    You can use the Fabric Invoke pipeline activity to execute another Microsoft Fabric pipeline. You can use it to orchestrate the execution of one or multiple pipelines from within a single pipeline.

     

    If you set up such an architecture, Pipeline 2 will run only once pipeline 1 is successful
    and pipeline 3 will run when pipeline 1 and 2 are successful.

    Invoke pipeline activity - Microsoft Fabric | Microsoft Learn

    I hope this information helps. Please do let us know if you have any further queries.
    Thank you

BharathKumarS's avatar
BharathKumarS
Regular Visitor
1 year ago

Hi Suryyyaaaa,

You can achieve this by calling fabric pipelines in ADF using web activity. 
You can do it either by using Service Principal or Managed Identity of ADF.
1. In Fabric admin portal, allow service principals to call Fabric API.

2. Add ADF/SPN as Contributer in Fabric workspace.

3. In ADF use web activity and create below url with your workspaceId and pipelineid

'https://api.fabric.microsoft.com/v1/workspaces/{WorkspaceId}/items/{PipelineId}/jobs/instances?jobType=Pipeline'

Authentication: System Assigned Managed Identity

Resource: https://api.fabric.microsoft.com/

4. After some timeout you can check the status of the fabric pipeline using below format. (This is web2 activity which is used to check status of previous call)

@concat('https://api.fabric.microsoft.com/v1/workspaces/{WorkspaceId}/items/{PipelineId}/jobs/instances/',activity('Previous_web_activity').output.id)

Flow:

web1->until_web2_gets_output(wait->web2)->onsuccess->web3(2nd pipeline)

 

you can configure next pipeline based on outputof previous web activity which checks the status of 1st pipeline run. And take advantage of ADF pipeline scheduling.
Hope this helps, If you find this usefull do give a Kudos and let me know if you have any doubts.
Please Mark as Answer If this was solves your problem.

Thanks & regards,
Bharath Kumar S