Forum Discussion
Pipeline Keeps Running Repeatedly
Hi everyone,
I had a Fabric pipeline that kept failing due to one activity, and I didn’t notice it over the weekend. It kept retrying automatically and ended up consuming a lot of capacity.
Even after disabling all activities, the pipeline still keeps retrying a few times.
How can I completely stop retries for the whole pipeline? Is there a way to prevent automatic retries or limit them?
Hi martymwas
The case you describe may have two root causes:
1. As Srisakthi described, it may be due to the retrying policies. So, it is important to set the necessary amount of retryes.
2. The other thing sometimes may happen is the glitch in the system. Similarly, it may happen with the Spark notebooks, for example. So, if the step #1 doesn't help -- and you tried to terminate that pipeline using monitoring, and there is no way to fix that - the only way is to create a support ticket to Microsoft.
To do this, you may use that link:
https://support.fabric.microsoft.com/
I hope this helps. Like and making that a solution is highly appreciated.
BR, Yurri
Independent advisor and Utah's Fabric Group Co-lead
2 Replies
- Srisakthi
Super User
Hi martymwas ,
To handle transient failures such as network disruptions or temporary service unavailability, Fabric allows you to define retry policies at the activity level within a pipeline. These policies let you specify the number of retry attempts and the delay between each retry.
Have you checked your pipeline if there is any retry policy has been set?
- 4iurchenko
Advocate III
Hi martymwas
The case you describe may have two root causes:
1. As Srisakthi described, it may be due to the retrying policies. So, it is important to set the necessary amount of retryes.
2. The other thing sometimes may happen is the glitch in the system. Similarly, it may happen with the Spark notebooks, for example. So, if the step #1 doesn't help -- and you tried to terminate that pipeline using monitoring, and there is no way to fix that - the only way is to create a support ticket to Microsoft.
To do this, you may use that link:
https://support.fabric.microsoft.com/
I hope this helps. Like and making that a solution is highly appreciated.
BR, Yurri
Independent advisor and Utah's Fabric Group Co-lead