Reply
chetnachaudhari
Advocate I
Advocate I

Scheduling a data pipeline

Hi community,

We use data pipelines to invoke a series a activities that include script activity, notebook and lookup. We would like to schedule this pipeline to run on a monthly basis but couldn't see that option, the only options available are as below

chetnachaudhari_0-1719432001967.png

Has anyone encountered this situation and how did you resolve it?

 

Thanks,

Chetna

1 ACCEPTED SOLUTION
NandanHegde
Super User
Super User

Fabric as of today doesnt support Monthly schedule functionality similar to Azure data factory.

So there can be 2 ways:

1) Schedule it weekly and have a IF activity at the start to chcek whether the trigger day is equivalent to the monthly schedule which you prefer; if yes proceed with the further process or skip and complete the pipeline run

2) Use some other offerings that supports Monthly schedules like Azure data factroy, Logic app etc to either trigger the data pipelines via REST API or to upload a file in blob and enable event trigger (in preview) on the fabric data pipeline




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

View solution in original post

4 REPLIES 4
toribiolmSXP
Frequent Visitor

Probably the option to schedule monthly refreshes wasn't available back in June 2024, but it is now in case you still need it.

toribiolmSXP_0-1739724507282.png

 

chetnachaudhari
Advocate I
Advocate I

Thanks for the response @NandanHegde . I'll try the first option.

 

Thanks,

Chetna

NandanHegde
Super User
Super User

Fabric as of today doesnt support Monthly schedule functionality similar to Azure data factory.

So there can be 2 ways:

1) Schedule it weekly and have a IF activity at the start to chcek whether the trigger day is equivalent to the monthly schedule which you prefer; if yes proceed with the further process or skip and complete the pipeline run

2) Use some other offerings that supports Monthly schedules like Azure data factroy, Logic app etc to either trigger the data pipelines via REST API or to upload a file in blob and enable event trigger (in preview) on the fabric data pipeline




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

What Expression needs to write here "Schedule it weekly and have a IF activity at the start to chcek whether the trigger day is equivalent to the monthly schedule which you prefer; if yes proceed with the further process or skip and complete the pipeline run"

avatar user

Helpful resources

Announcements
MarchFBCvideo - carousel

Fabric Monthly Update - March 2025

Check out the March 2025 Fabric update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)