Forum Discussion

MikolajSikorsk's avatar
MikolajSikorsk
Frequent Visitor
1 year ago
Solved

Dataset refresh too long (Sometimes)

Hi,   In the company we use Golden Dataset for reports (~20 reports connected). Usually refresh takes around 1-1:20 hrs. But sometimes (usually on Mondays) refresh progresses 4+ hrs. I dont know...
Need Help
  • andrewsommer's avatar
    andrewsommer
    1 year ago

    I am less concerned with the jump in refresh time from an hour + to 4 hours + than I am with the refresh even taking an hour +.  Even the largest and most complex semantic models I have come across rarely take longer than 20 minutes.  I had a client a few years ago in the Health Care sector that had a bloated 6GB model that was highly inefficient, and it never even took 40 minutes.

     

    My first suggestion would be to look at your query design.  Avoid a lot of heavy transformations.  If you can set up your queries as dataflows and then ingest the data flows into your model so you are segregating the ETL from the model refresh and you can isolate inefficient queries. 

     

    Check your report settings to make sure that parallel loading of tables is enabled. 

v-pnaroju-msft's avatar
v-pnaroju-msft
Community Support
1 year ago

Thank you, Akash_Varuna, for your response.

Hi MikolajSikorsk,

We appreciate your inquiry through the Microsoft Fabric Community Forum.Thank you for providing detailed information regarding the dataset refresh issue.

Since the issue occurs occasionally, particularly on Mondays, while all other factors remain consistent, it is likely that the problem is related to global shared resource contention. Although Power BI Premium Per User (PPU) licenses offer enhanced performance, they still depend on shared resources within the Power BI service, which may experience higher demand during peak times.

Please follow the steps below, which may help resolve the issue:

  1. Navigate to the dataset settings in the Power BI Service, select Scheduled Refresh, and examine the refresh history to identify any patterns or errors during extended refresh periods.
  2. Since the queries are consistent, consider using Query Diagnostics to ensure that no unexpected changes or inefficiencies have been introduced during the refresh process.
  3. If consistent performance is critical for your organisation, upgrading to Power BI Premium Capacity may be beneficial, as it provides dedicated resources and eliminates the impact of shared resource contention.

Additionally, you may refer to the following link for further insights:
Query diagnostics - Power Query | Microsoft Learn

 

If you find this response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar queries.

 

Thank you.