Forum Discussion

JibinSebastian's avatar
JibinSebastian
Icon for Advocate II rankAdvocate II
6 months ago
Solved

Scheduling a Microsoft Fabric Pipeline with Specific Time Intervals

I would like to configure a Microsoft Fabric pipeline to run on a recurring schedule with the following requirements: Execute every 10 minutes Start time: 7:10 AM EST End time: 6:50 PM EST Frequ...
data engineering
JibinSebastian's avatar
JibinSebastian
Icon for Advocate II rankAdvocate II
6 months ago

Hi @debroshi, thank you for your response.

I currently have two pipelines:

  1. The first pipeline uses Copy Data to move a small amount of data from a large SQL Server table.
  2. The second pipeline is for refreshing a semantic model.

I’m new to Microsoft Fabric and ran into a couple of issues:

  • I tried scheduling the pipeline to run every 10 minutes. It works during active hours, but when Fabric is suspended (outside 7 AM to 7 PM), the pipeline fails to execute.
  • For the semantic model refresh, the scheduler only allows a minimum interval of 30 minutes. However, I need it to refresh every 10 minutes on weekdays between 7 AM and 7 PM.

Could you please guide me on how to set up the trigger properly? It would really help if you could explain it in simple, beginner-friendly terms.

Thank you!

lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
6 months ago
For the semantic model refresh, the scheduler only allows a minimum interval of 30 minutes. However, I need it to refresh every 10 minutes on weekdays between 7 AM and 7 PM.

 

That is way too frequent.  Consider using Direct Query connection or streaming datasets/RTI.

 

Note:  If you request a refresh via API (for example through Power Automate) there is no such limit - but you must implement your own polling to find out if there is currently a refresh in progress before you submit another request.