Forum Discussion
Scheduling a data pipeline
Hi community,
We use data pipelines to invoke a series a activities that include script activity, notebook and lookup. We would like to schedule this pipeline to run on a monthly basis but couldn't see that option, the only options available are as below
Has anyone encountered this situation and how did you resolve it?
Thanks,
Chetna
Fabric as of today doesnt support Monthly schedule functionality similar to Azure data factory.
So there can be 2 ways:
1) Schedule it weekly and have a IF activity at the start to chcek whether the trigger day is equivalent to the monthly schedule which you prefer; if yes proceed with the further process or skip and complete the pipeline run
2) Use some other offerings that supports Monthly schedules like Azure data factroy, Logic app etc to either trigger the data pipelines via REST API or to upload a file in blob and enable event trigger (in preview) on the fabric data pipeline
4 Replies
Fabric as of today doesnt support Monthly schedule functionality similar to Azure data factory.
So there can be 2 ways:
1) Schedule it weekly and have a IF activity at the start to chcek whether the trigger day is equivalent to the monthly schedule which you prefer; if yes proceed with the further process or skip and complete the pipeline run
2) Use some other offerings that supports Monthly schedules like Azure data factroy, Logic app etc to either trigger the data pipelines via REST API or to upload a file in blob and enable event trigger (in preview) on the fabric data pipeline
Probably the option to schedule monthly refreshes wasn't available back in June 2024, but it is now in case you still need it.
