Forum Discussion
Notebook Error: SparkCoreError/PersonalizingFailed: Livy session has failed
Hi mdhewitt83
Unfortunately I failed to publish an environment with great-expectations 0.18.19 today. I got the following error. I tried PyPI and Conda sources, both failed. But for v1.0.0a1, it succeeded.
However when I published an environment with the same 0.18.19 version last week, it succeeded.
Did you get the same error notification when the publish failed?
Best Regards,
Jing
Hey Anonymous , that is the same error.
Hi mdhewitt83
I checked the error log of my publish failure. It seems the library was installed successfully in a new environment but the environment publish failed due to some error. I haven't found any solution or workaround yet. I will escalate this Publish environment failure issue internally, and update here once I got any feedback.
For the initial "SparkCoreError/PersonalizingFailed: Livy session has failed." error, I'm not sure if it has anything to do with the great-expectations library in the environment where your notebook run in. I would suggest raising a support ticket at Microsoft Fabric Support and Status | Microsoft Fabric
Best Regards,
JingHi mdhewitt83
I have escalated the publish failure issue internally but the engineer couldn't reproduce it. It seems not a general issue.
I'd like to confirm with you that whether you can publish an environment with the current release (0.18.19) of great-expectations library at present? If it still failed, you can try to find the error logs. Try publishing the environment again, and you may see below messages. Click View log, then View details. It will generate the logs in a new browser tab. See if there is any error in it.
If you still cannot publish the environment, I suggest creating a support ticket to investigate this further.
Best Regards,
Jing