Forum Discussion
Failed to create Livy session for executing notebook.
Hi, In Microsoft Fabric, we are gettting the following types of error when running notebooks in a pipeline. "traceback":["Exception: Failed to create Livy session for executing notebook. Liv...
I have run into this error on many occasions and it can often be solved by limiting the number of notebooks running in parallel. It seems to hit a limit of how many notebooks can run at once. Instead of waiting for compute to be available, it just fails.
But I've also had this happen when only running a single notebook...
We've been getting the Livy Session did not enter idle state after 10 minutes Error intermittently. our pipelines tend to run notebooks sequentially, but there can be an overlap once in a while. But.... our notebooks do very little processing. they normally take 3-10s to complete. so how contention is causing this is baffling me.