2 Datasets Refreshing at the same time

[cassidy]

There are certain hours throughout the day where I have 1 very large Dataset refreshing at the same time as 1 very small Dataset, and they seem to impact eachother.

For example:

Large Dataset refresh time is typically 1 hour, every 3 hours.

Small Dataset refresh time is typically 3 minutes, every 30 minutes.

When the two overlap, the Small Dataset can run for up to 30 minutes.

Is it expected to see that impact?  Is there a way to give priority to the Smaller Dataset?

[v-yingjl]

Hi @cassidy ,

If you've fixed the issue on your own please kindly share your solution. If the above posts help, please kindly mark it as a solution to help others find it more quickly. Thanks!

Best Regards,
Yingjie Li

[v-yingjl]

Hi @cassidy ,

If these two datasets configured under the same gateway, it is a normal phenomenon. 

When different datasets are refreshed in parallel under the same gateway, the gateway resources will be occupied at the same time. The refreshing time for a small dataset is naturally longer than the time for a single refresh of this dataset.

Currently, there is no option to select the refresh priority for the data set. We recommend that you avoid the same time period when configuring the scheduled refresh for each dataset to reduce resource occupation, and if your dataset has data sources from the cloud, you can refresh it directly through the cloud without configuring a gateway for it. In addition, you can also refer this document  to adding a gateway cluster.

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

[cassidy]

Thanks for the response @v-yingjl .  Neither Dataset uses a gateway, both pull from predominantly from Dataflows or an Azure Database.  Does that change anything about your recommendations?

[v-yingjl]

Hi @cassidy ,

It is a better suggestion to avoid refreshing different datasets in the same time period in power bi service currently regardless of whether you use a gateway or not.

In addition, here is an idea about refresh priority in power bi service, you can vote for it to help us improve power bi and making this feature coming sooner.

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.