topic Dependency failures blocking notebook execution in Data Engineering

Dependency failures blocking notebook execution

dseym-brb — Fri, 14 Mar 2025 11:55:05 GMT

Hello,

Last night, we started seeing widespread failures of notebooks running in pipelines which caused most of our nightly import jobs to fail. It looks like the errors are related to imports of internal dependencies. I tried running the notebooks using the 1.3 and 1.2 Spark runtimes. Here are a few examples of the errors that show up:

Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - ModuleNotFoundError, Error value - No module named 'fsspec_wrapper.trident.core'' :

Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - NameError, Error value - name 'mssparkutils' is not defined' :

The former looks like a sub-dependency of the pandas library. The latter is notebookutils which we haven't needed to explicitly import. In all cases, these look like bundled dependencies with another package or with the runtime.

This looks a lot like the outage from January 30th where the Fabric team had done some updates on the 1.3 runtime that caused dependency issues, but in that case we were able to workaround by downgrading to 1.2. In this case, both 1.3 and 1.2 have the same problem.

Notebooks with few or no dependencies invoked are running as expected.

Anyone else experiencing this?

Re: Dependency failures blocking notebook execution

theross — Fri, 14 Mar 2025 13:23:59 GMT

Looks like the same issue being discussed here - Python Module Not Found Error When Importing Panda... - Microsoft Fabric Community

Re: Dependency failures blocking notebook execution

Anonymous — Tue, 18 Mar 2025 09:51:37 GMT

Hi @dseym-brb,

Thank you for reaching out in Microsoft Community Forum.

Thank you @theross for the helpful response.

As suggested by theross , I hope the thread is address your query. Please let me know if you have any further questions or you'd like to discuss this further. If this answers your question, please "Accept as Solution" and give it a 'Kudos' so others can find it easily.

Please continue using Microsoft community forum.

Regards,
Pavan.

Re: Dependency failures blocking notebook execution

Anonymous — Fri, 21 Mar 2025 15:27:41 GMT

Hi @dseym-brb,

Could you please confirm if this issue has been resolved? If it has, kindly mark the helpful reply and "Accept as Solution" and additionally give 'Kudos'. This will assist other community members in resolving similar issues more quickly.

Regards,
Pavan.

Re: Dependency failures blocking notebook execution

dseym-brb — Fri, 21 Mar 2025 18:54:36 GMT

Hi, the issue does not appear to be resolved- the other ticket linked is still open so the problem persists. However, we can close this as a duplicate.