Forum Discussion

ToddChitt's avatar
ToddChitt
Icon for Super User rankSuper User
2 years ago
Solved

Notebook fails with error 200 when run from Pipeline

I'm fairly new to Spark Notebooks. I have one that dumps a JSON file into a couple of tables in my Lakehouse. It works fine when the Notebook is run on its own. But when I try to run it from the cont...
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi ToddChitt 

    Thanks for the details. Can you please send me the code which you are running in the notebook? I will try to repro this from my side and let you know.

    And also can you please try to create a new notebook and then attach the lakehouse. Now try to run this notebook from the pipeline. If the issue still persists please do let me know. This way there wont be a grey out option and you can attach or detach the lakehouse.


    Did you try to set the target lakehouse as the default lakehouse? Default lakehouse is identified by the pin icon.

     



    Thanks.

ToddChitt's avatar
ToddChitt
Icon for Super User rankSuper User
2 years ago

Hello Anonymous and thank you for the prompt reply.

Per your suggestion I created a new stand-alone notebook (i.e.: NOT from already inside the lakehouse) then manually ADDED the lakehouse as a new source. 

 

This worked! Invoking the Notebook from the context of a Pipeline run just fine.

 

Thank you. 

Do you still want the code? All it does is read a JSON file, parse it into 4 data frames and save each to a table in the lakehouse.