topic Re: Complex scheduling options for pipelines in Fabric in Pipelines

Complex scheduling options for pipelines in Fabric

VickyDev18 — Fri, 12 Jan 2024 12:23:09 GMT

The scheduling option in Fabric pipelines seem quite limited. I cannot run a job at specific times of the day or run it repeatedly but only during a certain time of the day, or setup multiple schedules etc.

Are there any plans to upgrade the scheduling features in the near future?

Re: Complex scheduling options for pipelines in Fabric

Anonymous — Tue, 16 Jan 2024 06:42:49 GMT

Hi VickyDev18

Thanks for using Fabric Community.
Currently Fabric supports Scheduled triggers for pipelines. But more triggers will be added to Microsoft Fabric shortly.

For more information please refer to this link: Link1

Hope this helps. Please let us know if you have any further questions.

Re: Complex scheduling options for pipelines in Fabric

VickyDev18 — Thu, 18 Jan 2024 13:37:50 GMT

I am not necessarily looking for additional ways to trigger but additional options within scheduling itself e.g. ability to setup multiple schedules so we can setup say an hourly refresh on week days and perhaps a once a day refresh on week ends or more frequent refreshes during the day and less frequent during nights etc.

Re: Complex scheduling options for pipelines in Fabric

Anonymous — Thu, 18 Jan 2024 17:28:26 GMT

Hi VickyDev18
Thanks for explaining the ask. Currently multiple schedules for a pipeline is not available in Fabric.
But you can acheive this by using Invoke Pipeline activity. You can create a main pipeline and invoke this in various pipelines.

You can schedule individual triggers for these child pipelines.
Hope this helps. Please let me know if you have any further questions.

Re: Complex scheduling options for pipelines in Fabric

Anonymous — Fri, 19 Jan 2024 17:15:31 GMT

Hi VickyDev18
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks

Re: Complex scheduling options for pipelines in Fabric

MG86 — Tue, 11 Jun 2024 16:17:12 GMT

This is very inconvenient. If I want to run a pipeline every half hour between 6 am and 8 pm I would need to set up three 'child pipelines' as you describe. Because 'by the minute' misses a timeframe setting and 'Daily' is limited to 10 timeslots only (why not just have 48 like you can with semantic model refresh settings).