Setting up alerts for scheduled data pipelines

[TAPeri]

I am monitoring several data pipelines across Fabric workspaces, and I would like to receive an email whenever any of them fails. 

I know I could add an Outlook activity to each of them individually, or create a 'parent' pipeline that invokes all the children pipelines and then sends an email, but that would require that I change all existing pipelines/schedules.

Isn't there a trivial way to do this? I'm looking for a 'send notification on failure' checkbox but I can't find anything in the Data Factory version of Fabric.

Thank you in advance!

[Anonymous · Accepted solution]

Hi @TAPeri ,

Currently there is no such feature in Fabric Data Factory as you mentioned.

But I think you can refer to these two methods below.

1. Select the three dots to find a list of options. Then select View run history. This action opens a fly-out on the right side of your screen with all your recent runs and run statuses.

You can read this document for a further study: 

How to monitor pipeline runs - Microsoft Fabric | Microsoft Learn

2. You have also mentioned the use of Outlook, similarly you can use Teams. here is a topic you can refer to:

Solved: Data Pipeline failure alert - Microsoft Fabric Community

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[gpalsson]

The Fabric way of handling and monitoring errors is a straight up downgrade from ADF in every possible way. I hope they fix it.

[NandanHegde · Accepted solution]

Unfortunately, unlike ADF wherein you can have in built alerts to notify in case of pipeline failures; in fabric data pipelines you have to explictily manage the failure notifications yourself.

Rather than having team/outlook activity after each activity or having a parent pipeline, you can use the below method :

https://www.c-sharpcorner.com/article/error-logging-and-the-art-of-avoiding-redundant-activities-in-...

[Anonymous · Accepted solution]

Hi @TAPeri ,

Currently there is no such feature in Fabric Data Factory as you mentioned.

But I think you can refer to these two methods below.

1. Select the three dots to find a list of options. Then select View run history. This action opens a fly-out on the right side of your screen with all your recent runs and run statuses.

You can read this document for a further study: 

How to monitor pipeline runs - Microsoft Fabric | Microsoft Learn

2. You have also mentioned the use of Outlook, similarly you can use Teams. here is a topic you can refer to:

Solved: Data Pipeline failure alert - Microsoft Fabric Community

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[annhwallinger]

Is it on the roadmap to add this capability? ADF had it built in and for obvious reasons it is needed.

[gpalsson]

Id like to know that too.

Microsoft, please:

We get new features every day that no one asked for, and standard monitoring for errors doesn't exist yet and is a mess compared to ADF. Why not just copy/paste ADF and maybe stop pushing new features for a while?