topic Re: trigger dataflow/datapipeline monthly in Pipelines

trigger dataflow/datapipeline monthly

PhilippM — Wed, 29 May 2024 05:24:33 GMT

Hey there,

I am trying to do a monthly trigger for my dataflow and datapipeline. The options only show every minute/hour/day/week, but in this scenario I would like to do a snapshop on the 1st every month.

I thought about running it daily and adding an if-condition to my dataflow to check whether it is the first of the month before running the rest of the flow. But that seems more like a workaround to me. Do you guys know of any better options?

Re: trigger dataflow/datapipeline monthly

Anonymous — Wed, 29 May 2024 05:40:30 GMT

Hi PhilippM
Thanks for using Fabric Community.
Unfortunately, Microsoft Fabric does not provide a direct option to schedule a monthly trigger. But this trigger is in plan. There is no ETA available yet.
You can refer to this thread for more information:
Re: Best way to set monthly job for data pipeline ... - Microsoft Fabric Community

Hope this helps. Please let me know if you have any further questions.

Re: trigger dataflow/datapipeline monthly

PhilippM — Wed, 29 May 2024 05:49:14 GMT

Hey Anonymous,

thank you for the quick reply and sharing the link. Good to know that it is in plan!

Since there is no inbuilt solution I will share my workaround as well, if anybody else needs it. It is just an if-condition with the formula @equals(dayOfMonth(utcNow()),1)

Re: trigger dataflow/datapipeline monthly

Anonymous — Wed, 29 May 2024 05:50:55 GMT

Thanks for sharing your work around and contributing to Fabric Community PhilippM
Please continue using Fabric Community for any help regarding your queries.