Trigger pipeline run from GUI while other pipeline is running does not seem possible

[KimTutein]

Hi Community

Trigger pipelien run from GUI while other pipeline is running

I am having trouble to trigger a datapipeline from the GUI while it is running. I have a pipeline setup with a master pipeline that will trigger other pipeline – basically it will trigger load of tables to lakehouse based on input in parameter. It works fine but it seems to me one are not able to run multiple instance of a datapipeline from the GUI. We only have the option to press either “Run” (which seems to be like debug from Synapse setup) or “Add trigger”. When you press “Run” you get the possibility to specify your parameters but you cannot rerun the pipeline before it is done (or make changes to the pipeline). In Synapse you have the possibility to press “Trigger now”, which also will prompt you for parameters and do not block the GUI. This is a rather large drawback compared to Synapse as we will not be able to start multiple pipelines ad-hoc of our parameter driven datapipeline setup.

Anyone have found a way around this?

[KimTutein]

Hi @Anonymous 

Thank you for the reply. If I open in another seperat browser I still see the ongoing pipeline running. The easiest way for me was to make a pipeline on top of my master pipeline I call "..... ad_hoc". This simply have a start pipeline with no wait option - that is then finished in one second and ready to fire again.

[Anonymous · Accepted solution]

Hi @KimTutein ,

Here are my own personal thoughts:

1. One approach is to open the data pipeline in different browser sessions or tabs. This can allow you to start a new instance of the pipeline while another instance is still running.

You can read this topic below:

Solved: Triggering multiple pipelines at the same time - Microsoft Fabric Community

2. You can manually trigger the pipeline using APIs, such as the REST API, .NET SDK, Azure PowerShell, or Python SDK. This method allows you to run multiple instances with different parameters without relying on the GUI.

Here is a document you can read:

Pipeline execution and triggers - Azure Data Factory & Azure Synapse | Microsoft Learn

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.