Forum Discussion

suriaprakash's avatar
suriaprakash
Frequent Visitor
2 years ago
Solved

Notebook Run Is Failing Continuously

Hi,   The notebook in my pipeline is continuously failing despite multiple retries. Occasionally, it runs fine. This issue started on 07/18 at midnight PT and still persists as of 07/19 at midnight...
Dataflow
Need Help
  • suriaprakash's avatar
    suriaprakash
    2 years ago

    The problem got sorted out automatically. New spark pool with unlimited executors didn't solve the issue. Looks like a Fabric issue which happened coninously for a day or so.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi suriaprakash ,

 

Thank you for posting in Fabric Community.


Are you using Azure notebooks? Because I see that your log format is Azure format and there is a difference between Azure synapse and Fabric synapse.

  • suriaprakash's avatar
    suriaprakash
    Frequent Visitor
    2 years ago

    No, we're using Fabric notebooks.

    And, the issue wasn't occuring now.

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      suriaprakash ，
      We are very glad to know that the issue has been resolved.


      Did you fix it by creating a new Spark pool with no limit on executor count?


      If so, please remember to accept your solution as answer.

       

      It will do great help to those who meet the similar question in this forum.

      • suriaprakash's avatar
        suriaprakash
        Frequent Visitor
        2 years ago

        The problem got sorted out automatically. New spark pool with unlimited executors didn't solve the issue. Looks like a Fabric issue which happened coninously for a day or so.