Forum Discussion
Helper IVWorkspace Resource Metrics (pro vs premium)
We have a few premium per user accounts, but the bulk of our users are pro users.
When I look at the refresh summary it only features premium workspaces, we can monitor refresh times and durations via the api and sharepoint. The only 'metrics' I can see are the manage group storage tab, where I am currently using 200mb out of 10gb for 6 datasets in this pro workspace.
The more datasets I add the slower the refresh times become, with only one or two datasets they refresh within 5 minutes. Currently it takes between 15-25 minutes for all datasets to refresh.
How does the refresh schedule work? Does it stagger dataset refreshes? Does everything refresh at once? How am I supposed to make sure that the refresh times align with data warehouse updates if there is no info available for why datasets are refreshing slowly?
Hi rusgesig
You have to remember that a Pro licence is not using a dedicated resource, but is shareing the Microsoft Service servers with all other Power BI Pro licence users in your geographic area.
When a Pro licence schedules a refresh in Power BI Service, that refresh request enters a queue and may wait in the queue for up to an hour before being picked up and run. This is Microsoft managing the load on the Power BI servers which are used by all the Power BI community that have Pro licences. Manual refreshes are not queued but run straight away, so they appear to take less time.
If the time taken to refresh is important to you, you may be able to shorten the queue wait by scheduling a refresh outside of busy business times. Scheduled refreshes at 9:00PM are often quicker than those at 9:00AM.
Aside from that, there's not much else you can do apart from using a Premium Capacity or Premium Per User licence. The Premium licences run on dedicated capacity, so don't need to share with the rest of the community, hence queue times can be much shorter.
Hope this helps
Stuart
5 Replies
Hi rusgesig ,
1. How does the refresh schedule work?
you can refer to the following docs for understanding.
Data refresh in Power BI - Power BI | Microsoft Learn
Configure scheduled refresh - Power BI | Microsoft Learn
2.Does it stagger dataset refreshes?
You can set the time in the scheduled refresh to stagger the dataset refresh to avoid refreshing at the same time.
3.Does everything refresh at once?
If you set the corresponding refresh time, the data set will be refreshed at the corresponding time point.
4.why datasets are refreshing slowly?
There are many factors that can affect the slow refresh of a dataset, you can try to deploy incremental refresh or, as I said above, staggered refresh whenever possible.
Best regards,
Community Support Team Selina zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly
rusgesigThanks Selina,
I would however like some more specific info.
>If you set the corresponding refresh time, the data set will be refreshed at the corresponding time point.
Please see attached export of refresh times via the api:There are 6 datasets in the workspace, three of them scheduled to run on the 30 minute mark, and three on the hour mark. The three in the screenshot are all scheduled to start at 09:30. The workspace is normal pro capacity, and usage is 200mb of 10gb.
As you can see the start times are inconsistent - which is what I mean by simultaneously refreshing or staggering. Do all three datasets start a refresh request at 09:30 and then vie for resources to see which one gets started first?
How can I quantify/predict the starting delay/duration based on resource consumption?- Burningsuit
Resident Rockstar
Hi rusgesig
You have to remember that a Pro licence is not using a dedicated resource, but is shareing the Microsoft Service servers with all other Power BI Pro licence users in your geographic area.
When a Pro licence schedules a refresh in Power BI Service, that refresh request enters a queue and may wait in the queue for up to an hour before being picked up and run. This is Microsoft managing the load on the Power BI servers which are used by all the Power BI community that have Pro licences. Manual refreshes are not queued but run straight away, so they appear to take less time.
If the time taken to refresh is important to you, you may be able to shorten the queue wait by scheduling a refresh outside of busy business times. Scheduled refreshes at 9:00PM are often quicker than those at 9:00AM.
Aside from that, there's not much else you can do apart from using a Premium Capacity or Premium Per User licence. The Premium licences run on dedicated capacity, so don't need to share with the rest of the community, hence queue times can be much shorter.
Hope this helps
Stuart
- rusgesig
Thanks, this is pretty much the answer I'm looking for. We have a few users on premium per user, but too many contributors who only have pro licenses for the premium workspace solution in this case.
Hi rusgesig ,
I would recommend that you open a support ticket to better help you with issues such as usage and capacity load.
If you are a Power BI Pro licensee, you can create a support ticket for free and a dedicated Microsoft engineer will come to solve the problem for you.
It would be great if you continue to share in this issue to help others with similar problems after you know the root cause or solution.
The link of Power BI Support: Support | Microsoft Power BI
For how to create a support ticket, please refer to How to create a support ticket in Power BI - Microsoft Power BI Community
Best regards,
Community Support Team Selina zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly
