Forum Discussion

martymwas's avatar
martymwas
Icon for Helper I rankHelper I
5 months ago
Solved

Pipeline Keeps Running Repeatedly

Hi everyone,

I had a Fabric pipeline that kept failing due to one activity, and I didn’t notice it over the weekend. It kept retrying automatically and ended up consuming a lot of capacity.

Even after disabling all activities, the pipeline still keeps retrying a few times.

How can I completely stop retries for the whole pipeline? Is there a way to prevent automatic retries or limit them?

  • Hi martymwas 

     

    The case you describe may have two root causes:

    1. As Srisakthi described, it may be due to the retrying policies. So, it is important to set the necessary amount of retryes.

    2. The other thing sometimes may happen is the glitch in the system. Similarly, it may happen with the Spark notebooks, for example. So, if the step #1 doesn't help -- and you tried to terminate that pipeline using monitoring, and there is no way to fix that - the only way is to create a support ticket to Microsoft.

     

    To do this, you may use that link:

    https://support.fabric.microsoft.com/

     

    I hope this helps. Like and making that a solution is highly appreciated.

     

    BR, Yurri

    Independent advisor and Utah's Fabric Group Co-lead

2 Replies

  • Hi martymwas ,

     

    To handle transient failures such as network disruptions or temporary service unavailability, Fabric allows you to define retry policies at the activity level within a pipeline. These policies let you specify the number of retry attempts and the delay between each retry.

    Have you checked your pipeline if there is any retry policy has been set?

     
  • Hi martymwas 

     

    The case you describe may have two root causes:

    1. As Srisakthi described, it may be due to the retrying policies. So, it is important to set the necessary amount of retryes.

    2. The other thing sometimes may happen is the glitch in the system. Similarly, it may happen with the Spark notebooks, for example. So, if the step #1 doesn't help -- and you tried to terminate that pipeline using monitoring, and there is no way to fix that - the only way is to create a support ticket to Microsoft.

     

    To do this, you may use that link:

    https://support.fabric.microsoft.com/

     

    I hope this helps. Like and making that a solution is highly appreciated.

     

    BR, Yurri

    Independent advisor and Utah's Fabric Group Co-lead