Forum Discussion

cw88's avatar
cw88
Helper IV
2 years ago
Solved

Notifications on pipeline error

What options do I have to receive notifications about pipeline errors?

Is there a way to set up a notification on monitoring hub level, that sends an e-mail, for example, when (selected) pipelines break?

 

I can currently only find the way to attach an additional mail activity to each individual activity of a pipeline, but that isn't practicable... 😐

9 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi cw88 ,

    Thanks for using Microsoft Fabric Community.

    Apologies for the inconvenience.

    Set up a notification on monitoring hub level is not yet supported within Microsoft Fabric, as you said we need to use email activity at pipeline level to send alerts on failure.

     

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

     

    Hope this helps. Please let me know if you have any further queries.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hello cw88 ,

      We haven’t heard from you on the last response and was just checking back to see if your query was answered,
      Otherwise, will respond back with the more details and we will try to help .

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hello cw88 ,

        We haven’t heard from you on the last response and was just checking back to see if your query was answered,
        Otherwise, will respond back with the more details and we will try to help .
        In case if you have any other question on a different issue, we request you to open a new thread .

    • Anonymous's avatar
      Anonymous
      Not applicable

      I'm sure we'll get a pipeline-level solution for this eventually.

       

      But in the meantime, here's a simple method using the new Invoke Pipeline activity.

       

      1. Create your pipeline without any notification activities.
      2. Create a second empty pipeline, and add Invoke Pipeline to call your first pipeline.
      3. Add an Outlook activity to the "On fail" node of the Invoke Pipeline activity.

       

      This will trigger the email if any part of your inner pipeline fails.

    • cw88's avatar
      cw88
      Helper IV

      Thanks for the link, i will try it.

      But a very complicated way, i hope that there are more comfortable ways in the future... 

  • mibruhje's avatar
    mibruhje
    Microsoft Employee

    A few updates have been shipped that help with getting notified when your pipeline fails. 

    Email notifications for failed scheduled jobs: You can now receive email alerts when any schedulable item fails. This works across pipelines, notebooks, etc. i.e. any Fabric item with schedules.

    - https://learn.microsoft.com/fabric/data-factory/pipeline-runs#configure-failure-notifications

    https://learn.microsoft.com/fabric/fundamentals/job-scheduler#receive-notifications-for-failed-scheduled-jobs 

    Centralized management of these notifications (Preview): There's now a dedicated view in Monitoring Hub where you can manage and configure failure notifications across all your scheduled items in one place. Instead of needing to open each item individually.
    https://learn.microsoft.com/fabric/admin/monitoring-hub#schedule-failures-preview 

     

    We'd love to hear feedback in this space. Does this address the core need? What gaps remain? This will help prioritize what comes next. 

    • pace-jp's avatar
      pace-jp
      Advocate I

      I finally got this functionality in my tenet and I find that it's very useful in our, admittedly not huge, deployment. It pretty much gives me what I was looking for. Thanks!