Refresh Issue

[nareshr89]

My regular schedule or on demand refresh completes in 20 minutes but one of the schedule in a day takes over 2 to 4 hours to complete refresh. During this period im unable to refresh the dataset manually through Power BI Desktop  and the subsequent refresh also doesn't happen during this time. Need help how to fix this one off long schedule problem permanently.

[Anonymous · Accepted solution]

Hi @nareshr89 ,

Does this still happen now?

There are 3 places where the refresh might be slow:

1. Data source
2. Power Query engine
3. Analysis Services engine

Only load the data you need

• The more data you load, the slower the refresh will be
• So:
  - Remove any columns you don’t need
  - Filter out any rows you don’t need
  - Think about applying a limit on history, eg only loading one year of data
  - Do this as soon as possible, ideally before the data even reaches Power BI
• It’s easier to add data back if you need it than remove data from a dataset in production
• Deployment pipelines (in Premium) can be used to limit the amount of data you work with in a development environment.
  — You can check out my post about Power BI Deployment Pipelines <here> and Chris Webb’s “Limit The Amount Of Data You Work With In Power BI Desktop Using Parameters ...here>.

• More details: My dataset is taking too long to refresh! 

I have also found a similar post, please refer to it to see if it helps you.

Data Refresh takes a very long time 

• When you do joins/appends in Power Query it has to load the entire table into virtual memory. This causes a lot of paging and is very slow.

Best Regards

Community Support Team _ Polly

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[nickyvv]

Hi @nareshr89,

is the long refresh on a fixed time of the day? Or does it vary?

What sources is it using?

Is the source/one of the sources in heavy use when the refresh happens?

[nareshr89]

Im using a single dataset for which source is MySQL database from which all the reports have been prepared. Also, the frequency of long refresh varies, till now i have faced the issue between 12pm to 9pm.