topic Re: How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running? in Data Science

How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running?

arpost — Wed, 07 Aug 2024 17:55:15 GMT

Greetings, all. I am wanting a notebook to throw an error if a condition isn't met, and I want that error to show in a Data Factory pipeline that is triggering the notebook. How can I do this?

Re: How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running?

frithjof_v — Wed, 07 Aug 2024 18:58:51 GMT

I think you can use exit value in Notebook.

And then use the Notebook exit value as input for an IF Condition activity in your data pipeline.

https://community.fabric.microsoft.com/t5/Data-Pipelines/Referencing-notebook-exit-value-as-a-variable-in-a-data-pipeline/m-p/3507053

Re: How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running?

Anonymous — Tue, 13 Aug 2024 07:04:34 GMT

Hi @arpost ,

Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.

If these also don't help, please share more detailed information and description to help us clarify your scenario to test.

How to Get Your Question Answered Quickly

Regards,

Xiaoxin Sheng

Re: How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running?

arpost — Wed, 14 Aug 2024 15:58:18 GMT

Thanks for the reply, @frithjof_v. The challenge there is I'd then need to add logic in the pipeline to evaluate whether or not the exit value output indicates an error.

The solution I found (which I found somewhere on the internet that I don't recall) is to use raise Exception("Error message here"). Here's a modified version of the code block; the vars are just fake examples of operations I am performing:

if var == None: raise Exception("No match found.") else: var2 = var

This sends the exception back as an error to the pipeline so the Notebook activity actually fails, which is handy.

Re: How do you throw an error from a Notebook so a Data Factory pipeline knows to stop running?

frithjof_v — Wed, 14 Aug 2024 16:17:38 GMT

Nice, thanks for sharing!