Reply
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Best way to set monthly job for data pipeline in Fabric
08-21-2023
10:32 PM
I am making a data pipeline that should run once a month to aggregate monthly data but schedule interval can be set to one of minutes, hourly, daily and weekly. How can we setup monthly job?
3 REPLIES 3
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-11-2023
03:02 AM
Hey @shingot check if this could work for you (it was the solution i used to do a end of month trigger)
This assumes you want to do it on end of month
CODE:
"
declare @current_date datetime = GETDATE()
IF
CONVERT(varchar(10),@current_date, 120) = EOMONTH(getdate())
SELECT (either do your statement here or use a return value to pass it as a variable for the pipeline)
"
The pipeline executes everyday and does this validation first. If the current date is not the last day of the month, the pipeline will end there, if it's the last day of the month it'll execute the remaining pipeline (i send either a 0 or 1 as return and according to the returned value it either executes the rest of the pipeline or it stops there)
I think it's a more robust solution, since scheduling X amount of minutes will vary according to the number of days per month.
You can save the SQL query as a store procedure on datawarehouse, for instance, and invoke it on the pipeline.
Hope it helps.
Best regards,
Ricardo Marques
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-22-2023
07:10 AM
Thank you for the answer. I hope the monthly option will be available soon. For now, we might try to use minutes scheduler as a workaround e.g. 44640 (31 days, it's OK for now as our project is at PoC phase) but is there maximum limitation?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-21-2023
10:43 PM
Monthly scheduler is not supported yet. It is in plan.

Helpful resources
Recommendations
Subject | Author | Posted | |
---|---|---|---|
06-13-2025 06:01 AM | |||
06-14-2025 01:02 AM | |||
04-09-2025 02:45 AM | |||
12-03-2024 08:30 AM | |||
05-27-2025 10:30 AM |
Top Kudoed Authors (Last Month)
User | Count |
---|---|
4 | |
2 | |
2 | |
1 | |
1 |