Forum Discussion

worldexplorer81's avatar
worldexplorer81
New Member
1 year ago

Set alert on long running job

Hi, 

Can anyone advise how to get alerted if a job (data pipeline) is running longer than expected? The job is meant to complete within 30 mins. However, everytime it runs longer than 30 mins, I want to get an email alert. 

 

I have set up alerting on job Failure under Real-time > Fabric Events > Job events but can't seem to find a way for long running jobs. 

Thanks

Activator
General Question
Need Help

4 Replies

  • nilendraFabric's avatar
    nilendraFabric
    Icon for Super User rankSuper User
    1 year ago

    hi worldexplorer81 If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

    Fabric generates job events such as Microsoft.Fabric.ItemJobStatusChanged, which includes details like data.jobStartTime and data.jobEndTime

    You can use these events to monitor job durations.

    In the Real-Time Hub, create an event stream for job events by selecting the relevant event type (e.g., Microsoft.Fabric.ItemJobStatusChanged)
    Configure filters to monitor specific jobs or pipelines. For example, filter on data.jobStartTime to calculate the elapsed time since the job started.
    Use the "Set Alert" option in the Real-Time Hub to define conditions for alerts.

    For example, configure it to trigger if a job runs longer than 30 minutes

    Specify the action for the alert, such as sending an email notification

     

     

     

  • nilendraFabric's avatar
    nilendraFabric
    Icon for Super User rankSuper User
    1 year ago

    worldexplorer81  please try this

     


    1. Use Job Events in Real-Time Hub
    Microsoft Fabric's Real-Time Hub allows you to monitor job events, including job execution statuses.

     

     

    You can configure alerts based on these events.
    Navigate to the Real-Time Hub and select Fabric Events.
    From the list of events, choose Job Events, which include details such as job creation, status changes, and completion.
    Open the Job Events Detail Page and click on Set Alert to configure monitoring and alerting options.


    2. Configure Alert Conditions
    To monitor for long-running jobs:
    On the Set Alert page, select the event type Microsoft.Fabric.ItemJobStatusChanged .
    Add a filter condition to check if the job has been running longer than 30 minutes. For example, compare the start_execution_date with the current time minus 30 minutes.
    Under Action, choose to send an email or a Teams notification when this condition is met


    If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

    • worldexplorer81's avatar
      worldexplorer81
      New Member
      1 year ago

      Thanks for the reply. I was able to select Microsoft.Fabric.ItemJobStatusChanged along with my item. However, I'm stuck when trying to add the filter. I could not find start_execution_date as field. The closest I came across was data.jobStartTime. Is there another place in Realtime to manipulate the filters? 

       

      Thanks