topic Re: Set alert on long running job in Activator

Set alert on long running job

worldexplorer81 — Fri, 10 Jan 2025 22:22:14 GMT

Hi,

Can anyone advise how to get alerted if a job (data pipeline) is running longer than expected? The job is meant to complete within 30 mins. However, everytime it runs longer than 30 mins, I want to get an email alert.

I have set up alerting on job Failure under Real-time > Fabric Events > Job events but can't seem to find a way for long running jobs.

Thanks

Re: Set alert on long running job

lbendlin — Mon, 13 Jan 2025 03:10:36 GMT

If this is important to you please consider voting for an existing idea or raising a new one at https://ideas.fabric.microsoft.com

Re: Set alert on long running job

nilendraFabric — Thu, 16 Jan 2025 11:09:19 GMT

worldexplorer81 please try this

1. Use Job Events in Real-Time Hub
Microsoft Fabric's Real-Time Hub allows you to monitor job events, including job execution statuses.

You can configure alerts based on these events.
Navigate to the Real-Time Hub and select Fabric Events.
From the list of events, choose Job Events, which include details such as job creation, status changes, and completion.
Open the Job Events Detail Page and click on Set Alert to configure monitoring and alerting options.

2. Configure Alert Conditions
To monitor for long-running jobs:
On the Set Alert page, select the event type Microsoft.Fabric.ItemJobStatusChanged .
Add a filter condition to check if the job has been running longer than 30 minutes. For example, compare the start_execution_date with the current time minus 30 minutes.
Under Action, choose to send an email or a Teams notification when this condition is met

If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

Re: Set alert on long running job

worldexplorer81 — Thu, 16 Jan 2025 13:56:22 GMT

Thanks for the reply. I was able to select Microsoft.Fabric.ItemJobStatusChanged along with my item. However, I'm stuck when trying to add the filter. I could not find start_execution_date as field. The closest I came across was data.jobStartTime. Is there another place in Realtime to manipulate the filters?

Thanks

Re: Set alert on long running job

nilendraFabric — Thu, 16 Jan 2025 14:56:27 GMT

hi worldexplorer81 If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

Fabric generates job events such as Microsoft.Fabric.ItemJobStatusChanged, which includes details like data.jobStartTime and data.jobEndTime

You can use these events to monitor job durations.

In the Real-Time Hub, create an event stream for job events by selecting the relevant event type (e.g., Microsoft.Fabric.ItemJobStatusChanged)
Configure filters to monitor specific jobs or pipelines. For example, filter on data.jobStartTime to calculate the elapsed time since the job started.
Use the "Set Alert" option in the Real-Time Hub to define conditions for alerts.

For example, configure it to trigger if a job runs longer than 30 minutes

Specify the action for the alert, such as sending an email notification