Reply
shingot
Regular Visitor

Best way to set monthly job for data pipeline in Fabric

I am making a data pipeline that should run once a month to aggregate monthly data but schedule interval can be set to one of minutes, hourly, daily and weekly. How can we setup monthly job?

3 REPLIES 3
rickmarques
Frequent Visitor

Hey @shingot check if this could work for you (it was the solution i used to do a end of month trigger)

 

This assumes you want to do it on end of month

 

CODE:

"

declare @current_date datetime = GETDATE() 
 
IF

CONVERT(varchar(10),@current_date, 120) = EOMONTH(getdate())

SELECT (either do your statement here or use a return value to pass it as a variable for the pipeline)
"
 
The pipeline executes everyday and does this validation first. If the current date is not the last day of the month, the pipeline will end there, if it's the last day of the month it'll execute the remaining pipeline (i send either a 0 or 1 as return and according to the returned value it either executes the rest of the pipeline or it stops there)
 
I think it's a more robust solution, since scheduling X amount of minutes will vary according to the number of days per month.
 
You can save the SQL query as a store procedure on datawarehouse, for instance, and invoke it on the pipeline.
 
Hope it helps.
 
Best regards,
 
Ricardo Marques
 
shingot
Regular Visitor

Thank you for the answer. I hope the monthly option will be available soon. For now, we might try to use minutes scheduler as a workaround e.g. 44640 (31 days, it's OK for now as our project is at PoC phase) but is there maximum limitation?

GraceGu
Microsoft Employee
Microsoft Employee

Monthly scheduler is not supported yet. It is in plan. 

avatar user

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June FBC25 Carousel

Fabric Monthly Update - June 2025

Check out the June 2025 Fabric update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)