Forum Discussion

willmasse's avatar
willmasse
Frequent Visitor
2 years ago

Failed to create Livy session for executing notebook.

Hi,   In Microsoft Fabric, we are gettting the following types of error when running notebooks in a pipeline.    "traceback":["Exception: Failed to create Livy session for executing notebook. Liv...
data engineering
v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi willmasse 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.


Thanks

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi willmasse 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread.


Thanks

  • alozovoy's avatar
    alozovoy
    Advocate II
    2 years ago

    I have run into this error on many occasions and it can often be solved by limiting the number of notebooks running in parallel. It seems to hit a limit of how many notebooks can run at once. Instead of waiting for compute to be available, it just fails.

     

    But I've also had this happen when only running a single notebook...

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      We've been getting the Livy Session did not enter idle state after 10 minutes Error intermittently. our pipelines tend to run notebooks sequentially, but there can be an overlap once in a while. But.... our notebooks do very little processing. they normally take 3-10s to complete. so how contention is causing this is baffling me.