Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

October 28 & 29: Experts share their secrets on how to pass the Fabric Analytics Engineer certification exam—live. Learn more

Reply
aravindhsam8
Frequent Visitor

Notebook execution failed at Notebook service with http status code - '200'

I have a Master orchestration pipeline, which consist of 6 invoked pipelines running parallelly.

Within each invoked pipeline, there are 3 notebooks running in a series (ingestion notebook--->Silver Notebook ---> Gold Notebook).

I'm facing the below issue often in the random silver or gold notes books sparksql statement.

FYI,The tables provided in the statements are not used in any other notebooks, each notebook has it's own set of table list.

aravindhsam8_0-1729605369713.png

 

This is not only specific to "create table statement", it also occurs for "drop table if exist" statement too.

Master orchestration runs everyday which is schedule to run daily and this issue persist at least weekly thrice.

 

Thanks in advance.

4 REPLIES 4
v-huijiey-msft
Community Support
Community Support

Hi @aravindhsam8 ,

 

Thanks for the reply from lbendlin .

 

Can you check the data pipeline and the owner of the notebook? A similar problem may occur when the owner of the notebook is removed from the workspace. You can also check if the owner of the pipeline and notebook has access to all the items you need for your run.

 

Make sure you are using the Spark 1.3 runtime.

 

Can you try to add a retry run pipeline? See if the problem can be reproduced.

 

Best Regards,
Yang
Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

Hi @v-huijiey-msft , 
Thanks for the reply.

I have changed to Spark 1.3 runtime. I have also checked all the ownership of the items within the pipleine, everything are under my name. 

I have tried to provide retry option if failed for each notebook activity, the issue still persist, it fails on the first and succeed either on second or third.
But still the notbook fails, even though all the above options are checked.

HI @v-huijiey-msft , Just following back on this.
Kindly help on the above issue.
Thanks in advance.

lbendlin
Super User
Super User

This is not only specific to "create table statement", it also occurs for "drop table if exist" statement too.

 

I think these issues are related. Looks like your code sometimes fails to drop the table, and then it complans that it cannot create an existing table.

 

Helpful resources

Announcements
Sept Fabric Carousel

Fabric Monthly Update - September 2024

Check out the September 2024 Fabric update to learn about new features.

October NL Carousel

Fabric Community Update - October 2024

Find out what's new and trending in the Fabric Community.