Forum Discussion

DPCCGF's avatar
DPCCGF
Helper IV
1 year ago

Dataflow Schedule Not Working

We are in a small Fabric F2 capacity with one dataflow.  We are scheduling this dataflow to run every thirty minutes.  My research shows we should be allowed to refresh 150 times a day, but we are doing it 48 times as this is a scheduling dataflow.  We are not seeing it refreshing with the schedule, but do see successful refreshes every 2-4 hours.  On Demand refreshes might be working but nothing shows in the Recent Runs table.  How do I get what should be a simple process to work?  When it does run it runs in about 2-3 minutes.  Thanks in Advance!

10 Replies

  • Hello DPCCGF,

     

    Thanks for your question.

     

    F2 capacity is very small (2 CU) and is not guaranteed to run refreshes exactly at the scheduled frequency.

     

    I find that refreshes are queued and may be delayed if the capacity is under load or throttled... That’s why you’re seeing them run only every 2 - 4 hours.

     

    To run every 30 minutes reliably, you’ll need at least F4 or higher.

     

    Alternatively, I recommend to use Power Automate or the Fabric REST API to trigger refreshes more predictably.  This bypasses some of the scheduling throttles (but still depends on your capacity).

     

    Hope this helps.

    • DPCCGF's avatar
      DPCCGF
      Helper IV

      Sounds good, but should I not be able to just refresh ON DEMAND, like I do in other data models that are not in a Fabric workspace?  I am just trying that and nothing is working.

  • Shahid12523's avatar
    Shahid12523
    Community Champion

    On Fabric F2, 30-min dataflow schedules aren’t guaranteed → service may throttle, so you see 2–4 hr gaps.

     

    Fix:

    Use Power Automate / REST API to trigger refresh.

    Or upgrade to F4 / Premium for reliable scheduling.

  • v-ssriganesh's avatar
    v-ssriganesh
    Community Support

    Hi DPCCGF,

    Thank you for posting your query in the Microsoft Fabric Community Forum, and thanks to Shahid12523 & Sahir_Maharaj  for sharing valuable insights.

     

    Could you please confirm if your query has been resolved by the provided solutions? This would be helpful for other members who may encounter similar issues.

     

    Thank you for being part of the Microsoft Fabric Community.

  • Hi DPCCGF 

     

    The current user interface only allows you to configure the 48 refreshes, but you can use a data pipeline, for example to refresh the data flow on a schedule that works for you, where you can refresh it every 30 minutes.

     

    I also want to say that you could very well use an F2 capacity to do the refreshes. It all depends on how many capacity units are being used for that refresh schedule. If there is enough capacity, you absolutely could refresh it every 30 minutes. It's something you would need to look into your capacity metrics app to verify that you have enough capacity and then you could use as mentioned either Power Automate or another option to refresh it on a schedule. Then run exactly when you are refreshing it, especially if you are using an API.

  • v-ssriganesh's avatar
    v-ssriganesh
    Community Support

    Hello DPCCGF,

    We hope you're doing well. Could you please confirm whether your issue has been resolved or if you're still facing challenges? Your update will be valuable to the community and may assist others with similar concerns.

    Thank you.

  • v-ssriganesh's avatar
    v-ssriganesh
    Community Support

    Hello DPCCGF,

    Hope everything’s going great with you. Just checking in has the issue been resolved or are you still running into problems? Sharing an update can really help others facing the same thing.

    Thank you.