Automation of Monitoring Scheduled Pipelines and Notebooks

[liney_marcela]

Hi Community,

I need help creating a notebook that can perform the following activity: Currently, the pipelines and some notebooks are executed because we have manually scheduled them to run daily, weekly, etc., at certain times, with a start date and an end date. When the end date arrives (we have set several years in advance), the pipeline execution will stop.

At the moment, it is not possible to set an infinite end date so that the execution never stops.

I would like to create a pipeline that can search for all pipelines and notebooks across all workspaces, and for those with an active schedule, check when the end date is and send alerts when there are 1 month, 2 months, 3 months left until their end date, so that the execution period can be extended if necessary.

I have a Client ID and a Secret ID for authentication. Could you help me with this?

[v-prasare]

Hi @liney_marcela,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

[v-prasare]

Hi @liney_marcela, 

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

[v-prasare]

@liney_marcela, As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

@nilendraFabric , Thanks for your promt response

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

[lbendlin · Accepted solution]

You can use the sempy library to harvest and evaluate that information, including the schedules.  sempy.fabric package | Microsoft Learn

You will also want to consider using the tenant inventory reports and/or Purview to report on that kind of meta data.