Forum Discussion
Data Refresh takes a very long time
- Anonymous7 years ago
When you do joins/appends in Power Query it has to load the entire table into virtual memory. This causes a lot of paging and is very slow.
Does your dataset have to be refreshed on an approximatly hourly basis or is a daily cadence ok?
As this will greatly affect what options are open to you to increase performance.
hi, GuySev
For your dataset is so big, the performance will involve many aspects, you could refer to below documents and blogs that may help you:
https://docs.microsoft.com/en-us/power-bi/power-bi-reports-performance
http://blog.pragmaticworks.com/power-bi-performance-tips-and-techniques
https://www.sqlbi.com/topics/optimization/
Best Regards,
Lin
- GuySev7 years ago
Advocate I
Hi v-lili6-msft ,
Thank you for your reply!
As I stated, I already went through these performance articles and implemented quit a few techniques.
Quit frankly, this model is not that big at all. I have sum models that are twice and even three times bigger, but preform much better.
I'm trying to understand if a step I made on query view is causing this, or rather a calculated measure maybe.
Is there any way to measure what causes this slow down?
- Anonymous7 years agoNot applicable
When you do joins/appends in Power Query it has to load the entire table into virtual memory. This causes a lot of paging and is very slow.
Does your dataset have to be refreshed on an approximatly hourly basis or is a daily cadence ok?
As this will greatly affect what options are open to you to increase performance.
- GuySev7 years ago
Advocate I
Hi Anonymous ,
Thank you for this clarification, eventually I kind of figured out this is the case as well.
I changed my data model in order to avoid some of the appends and indeed performance increased substantially.
Thanks again!