topic Re: Setting up alerts for scheduled data pipelines in Pipelines

Setting up alerts for scheduled data pipelines

TAPeri — Tue, 03 Dec 2024 16:30:15 GMT

I am monitoring several data pipelines across Fabric workspaces, and I would like to receive an email whenever any of them fails.

I know I could add an Outlook activity to each of them individually, or create a 'parent' pipeline that invokes all the children pipelines and then sends an email, but that would require that I change all existing pipelines/schedules.

Isn't there a trivial way to do this? I'm looking for a 'send notification on failure' checkbox but I can't find anything in the Data Factory version of Fabric.

Thank you in advance!

Re: Setting up alerts for scheduled data pipelines

Anonymous — Wed, 04 Dec 2024 01:58:39 GMT

Hi TAPeri ,

Currently there is no such feature in Fabric Data Factory as you mentioned.

But I think you can refer to these two methods below.

1. Select the three dots to find a list of options. Then select View run history. This action opens a fly-out on the right side of your screen with all your recent runs and run statuses.

You can read this document for a further study:

How to monitor pipeline runs - Microsoft Fabric | Microsoft Learn

2. You have also mentioned the use of Outlook, similarly you can use Teams. here is a topic you can refer to:

Solved: Data Pipeline failure alert - Microsoft Fabric Community

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Setting up alerts for scheduled data pipelines

NandanHegde — Wed, 04 Dec 2024 03:39:33 GMT

Unfortunately, unlike ADF wherein you can have in built alerts to notify in case of pipeline failures; in fabric data pipelines you have to explictily manage the failure notifications yourself.

Rather than having team/outlook activity after each activity or having a parent pipeline, you can use the below method :

https://www.c-sharpcorner.com/article/error-logging-and-the-art-of-avoiding-redundant-activities-in-...

Re: Setting up alerts for scheduled data pipelines

annhwallinger — Tue, 07 Jan 2025 15:59:19 GMT

Is it on the roadmap to add this capability? ADF had it built in and for obvious reasons it is needed.

Re: Setting up alerts for scheduled data pipelines

gpalsson — Fri, 25 Apr 2025 15:56:51 GMT

The Fabric way of handling and monitoring errors is a straight up downgrade from ADF in every possible way. I hope they fix it.

Re: Setting up alerts for scheduled data pipelines

gpalsson — Fri, 25 Apr 2025 15:59:24 GMT

Id like to know that too.

Microsoft, please:

We get new features every day that no one asked for, and standard monitoring for errors doesn't exist yet and is a mess compared to ADF. Why not just copy/paste ADF and maybe stop pushing new features for a while?