Forum Discussion

ronan_b6's avatar
ronan_b6
Advocate II
2 years ago
Solved

Issues running Spark Notebook

Hi I'm runing spark notebooks on Fabric trial, it's been working great and no time out issues, or severe dalys in sessions starting.   But today, notebooks do not start the spark session, returning...
Notebook
  • ronan_b6's avatar
    ronan_b6
    2 years ago

    This issue persisted for a week. I updated to runtime 1.3 at the time and it had no effect on the issue. MS stated at the time it was a resource allocation issue. Since 07-18-2024 I have not experienced this issue with my pipelines. For now it seems MS has resolved the issue. (Central Canada)

vdgarcia's avatar
vdgarcia
Frequent Visitor
2 years ago

Hi I have the same issue today(30-JUL-2024), in US South Central Region ("Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - Exception, Error value - Failed to create Livy session for executing notebook.")

vdgarcia's avatar
vdgarcia
Frequent Visitor
2 years ago

Hi Again,

Today(31-JUL-2024), I have the same issue("SparkCoreError/SessionDidNotEnterIdle: Livy session has failed. Error code: SparkCoreError/SessionDidNotEnterIdle. SessionInfo.State from SparkCore is Error: Session did not enter idle state after 10 minutes. Source: System.").

 

I don't know if this behavior is related to my size capacity(F2), but at run time the capability does not execute any other processes.

 

Thank you.

  • kirah2128's avatar
    kirah2128
    Resolver I
    2 years ago

    I'm having the same error too. Hopefully they will fix this issue asap. 

    • vdgarcia's avatar
      vdgarcia
      Frequent Visitor
      2 years ago

      Hi, This problem persists using the stable version of Spark (1.2), however since I adjusted the Spark version to 1.3v (preview) the Notebooks now run without problems.

       

      I sincerely hope that the stable version 1.2 really works stably and we can keep it and run our production processes with confidence.