topic Re: Monitor does not show pipelines triggers by other pipelines in Pipelines

Monitor does not show pipelines triggers by other pipelines

KimTutein — Thu, 21 Nov 2024 06:15:07 GMT

It seems like the monitor hub in Fabric “only” shows “top datapipelines” and not for data pipelines that are started by other datapipelines. On one hand that might sometimes be nice when you like us have a setup which my have a lot of pipelines running. I would from time to time like to se all data pipelines that is running and not just top datapipelines.

Anyone know if this is possible in the monitoring hub (the only filter I have is the workspace)?

Re: Monitor does not show pipelines triggers by other pipelines

Anonymous — Fri, 22 Nov 2024 01:11:15 GMT

Hi KimTutein

In Microsoft Fabric's Monitoring Hub, it can indeed be a bit limiting since it primarily displays the "top data pipelines" and doesn't show all running pipelines, especially those initiated by other pipelines. Currently, the filtering options are somewhat restricted, focusing mainly on the workspace level.

However, you can enhance your monitoring experience by using the following features:

Sorting and Filtering: You can sort data pipeline runs by various columns like Name, Status, and Start Time. This might help you locate specific pipelines more easily.

Gantt View: This view allows you to see the run history over a time range, grouping all pipeline runs by name. It visually represents the duration of each run, which can be helpful for tracking multiple pipelines.

Search Functionality: Utilize the search box to find specific pipeline runs by entering keywords related to their names or statuses.

While these features might not provide a comprehensive view of all pipelines, they can help you manage and monitor your data pipelines more effectively.

How to monitor pipeline runs in Monitoring hub - Microsoft Fabric | Microsoft Learn

How to monitor pipeline runs - Microsoft Fabric | Microsoft Learn

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Monitor does not show pipelines triggers by other pipelines

KimTutein — Fri, 22 Nov 2024 06:41:33 GMT

HI Anonymous

Thank you for your reply - it is much appreciated.

A bit odd that the monitor hub is not able to show all runs. We have made logging to seperate table and a Power BI report on top of that logging table to better see what is going on.