Forum Discussion

bexy's avatar
bexy
Frequent Visitor
2 years ago
Solved

**Pipeline Monitoring Hub Data**

I would like to access the monitor hub data for all pipelines, including the start time, end time, status, and pipeline run ID. Additionally, I need detailed information on each pipeline's activities...
capacities
data hub
Data Integration
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi bexy 

     

    Apologies for the delay in response.

    Currently, In Microsoft Fabric, the Fabric Monitor Hub indeed lacks direct support for extracting detailed pipeline activity data using Python code. The Fabric Monitor Hub primarily serves as a visual interface, and its API doesn't expose detailed pipeline activity data.  

     

    However, your suggestion is definitely valuable! We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

    Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

     

    I hope this information helps.


    Thank you

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi bexy 

 

Thanks for using Microsoft Fabric Community.

In Microsoft Fabric, you can utilize the Monitoring hub to access information about pipelines and their activities. Open the Monitoring Hub:

  • In Fabric, navigate to the Monitoring hub from the navigation pane.
  • The monitoring hub displays information in a table form.
  • Fabric activities are listed based on their start time, with the newest activities at the top of the table.
  • Each Fabric item (such as pipelines) displays a maximum of 100 activities. 

Interact with the Monitoring Hub: 

  • Click on the column title to change the order of the table’s display. The arrow next to the column header indicates the sorting order.
  • Use the Column options button to add, remove, and rearrange the columns displayed in the table. Add: Select a column from the list. Remove: Remove the selection indicator from a column. Rearrange: Drag columns to your desired position.
  • Use the Filter button to filter the monitoring hub table results. Status: Select the type of status you want the table to display. If no status is selected, activities for all statuses are shown. Start Time: Choose a time period for the table display (you can customize it). Item Type: Select specific Fabric item types (e.g., pipelines) to display. Submitted By: Filter by the owner of the Fabric item. Location: Select which workspaces to view item activities from.

Historical View:

  • The monitoring hub keeps history for 30 days.
  • You can view historical data using the Historical view option.

To open the Monitoring hub, In Fabric, select Monitoring hub from the navigation pane. The monitoring hub displays information in a table form. Fabric activities are displayed according to their start time, with the newest activities at the top of the table. Any Fabric user can use the monitoring hub, however, the monitoring hub displays activities only for Fabric items you have permission to view. 

For additional information please refer : Use the Monitoring hub - Microsoft Fabric | Microsoft Learn

Please refer to the screenshots:

I hope this information helps. Please do let us know if you have any further queries.

 

Thank you.