Forum Discussion
Schedule a notebook to run automatically failed with the error code "InternalError"
Hello guys:
I've developed a Fabric notebook for a specific mail sending task, and I've been scheduled it to run automaticlly(every Mon). but the last two run have failed, with a error code "InternalError" and no more logs.
The notebook script should be fine, because I've clicked the "Run all" button after the schedule failed, and it worked fine.
Any pointers would be greatly appreciated.
Hi govindarajan_d Anonymous
After a period of investigation, Microsoft support gave feedback yesterday that the issue was indeed the result of a bug. They said that my notebook name has some unsupported characters, such as Chinese characters, etc., and there is a parameter in their product that doesn't support those characters, so it will fail to run.
They will be working on a fix for this issue and the ETA is at the end of March. The current solution is to use only ASCII characters in the notebook name, in which case everything works fine!
11 Replies
Hi govindarajan_d Anonymous
After a period of investigation, Microsoft support gave feedback yesterday that the issue was indeed the result of a bug. They said that my notebook name has some unsupported characters, such as Chinese characters, etc., and there is a parameter in their product that doesn't support those characters, so it will fail to run.
They will be working on a fix for this issue and the ETA is at the end of March. The current solution is to use only ASCII characters in the notebook name, in which case everything works fine!
Hi ZJoe,
Thanks for the response. As assumed, it was a MS bug! 😆 And thanks for letting us know, this helps!
Hi ZJoe,
So the notebook works in interactive manner but not when you run it in a scheduled manner?
Can you provide the script that you are using, without any sensitive information in it
Hi govindarajan_d ,
Yes, the notebook works fine when running each cell individually or when click the "Run all" button to run all cells in sequence.
the script has too many lines and contains a lot of business logic, sorry for can't provide directly. but I can introduce the main components of the script for you.
the notebook is a "PySpark(Python)" language script, using a customized environment with some public libraries and custom libraries installed.
First, it uses Spark SQL to process some data and write the result into a lakehouse tabe, for subsequent use.
Second, it imports some libraries and retrieves data from the lakehouse table
Finally, using pandas to process data based on business logic, and wirte each result dataframe into a ".xlsx" file(in a loop), which saved in the Built-in resources folder. then using email library to send mail for each person, with the corresponding file as an attachment.
The above is the main content of the script, I'm wondering if the problem might have something to do with the environment or the amount of data?
Thanks！
Hi ZJoe,
Most probably it might have to do with environment rather than amount of data.
In your workspace settings, have you set the default environment to be the one that you use to execute interactively?
