topic Re: How to purposely fail the notebook execution within a pipeline in Pipelines

How to purposely fail the notebook execution within a pipeline

Anonymous — Wed, 23 Oct 2024 18:46:22 GMT

Salutations!

If a condition in a spark notebook is fulfilled (details not important), I want to exit the run (like with mssparkutils.notebook.exit("peekaboo!") ). I also want the pipeline which executes this notebook via the notebook activity to register this run as failed, just like if it had incidentally done so, not on purpose. How do I do that? Is it a specific exit value? Do I have to throw an exception, and if so, how would I go about that?

I mean, I could put some impossible code into the notebook, but there has to be a better way, right?

Thanks for your help!

Re: How to purposely fail the notebook execution within a pipeline

Anonymous — Mon, 28 Oct 2024 01:53:17 GMT

Hi, Anonymous

You can use a Fail activity in a pipeline and customize both its error message and error code.

Please refer to the following documents for detailed information:

Fail activity - Microsoft Fabric | Microsoft Learn

Best Regards,

Community Support Team _Charlotte

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: How to purposely fail the notebook execution within a pipeline

jwinchell40 — Mon, 28 Oct 2024 02:01:13 GMT

Anonymous - Pass your error code/text in the .exit() message. Then read that output into a variable or IF condition in the data pipeline and if the failure condition is true use the Fail Activity to stop the pipeline.

- https://stackoverflow.com/questions/73517846/putting-dbutils-notebook-exit-in-both-try-and-except-will-only-shows-exit-in-e

You can return a JSON string from the Notebook to the Pipeline, parse it in the pipeline so you can refer to an Error Code # and Message easier than just a standard string.

Re: How to purposely fail the notebook execution within a pipeline

Anonymous — Mon, 28 Oct 2024 08:20:29 GMT

That is not what I want. I want the notebook activity itself to fail.

Re: How to purposely fail the notebook execution within a pipeline

jwinchell40 — Mon, 28 Oct 2024 11:56:46 GMT

Anonymous - Ok. Then you will not be able to use .exit() but you can raise an exception to exit the Notebook. You can pass a message back via the exception to perform additional steps if needed.

if var == None:
  raise Exception("No match found.")
else: 
    var2 = var