Forum Discussion
Slow refresh of SharePoint list data
- 9 years ago
Yes, pls try that.
Fetch your raw-data in one query and then reference this query. This will create a first step like so:
Source = NameOfTheQueryWithRawData
Change that step into this:
Source = Table.Buffer(NameOfTheQueryWithRawData)
Unfortunately, there's not much informations available around performance tuning at the moment (here are some additional details: https://blog.crossjoin.co.uk/2016/11/20/referenced-queries-and-caching-in-power-bi-and-power-query/)
Yes, pls try that.
Fetch your raw-data in one query and then reference this query. This will create a first step like so:
Source = NameOfTheQueryWithRawData
Change that step into this:
Source = Table.Buffer(NameOfTheQueryWithRawData)
Unfortunately, there's not much informations available around performance tuning at the moment (here are some additional details: https://blog.crossjoin.co.uk/2016/11/20/referenced-queries-and-caching-in-power-bi-and-power-query/)
Follow ImkeF example. If you need more details, post your query and I'll try to point where exactly you can benefit from Table.Buffers.
As for the reason why you need to have a Buffer in place, it is almost like forcing Power Query to firstly download all of the content from SharePoint first (into the Buffer) and then perform all of the other operations.
I assum that in your case, Power Query downloads portions of the list from SharePoint and then performs some pivoting, then fetches some more data from SharePoint again, etc. This way you are wasting a lot of time on waiting, and possibly on duplicate HTTP requests to SharePoint.
Of course this explanation is worth reading if the Table.Buffer works :)
- Matthias939 years ago
Helper III
Thanks for helping guys. I pulled in the raw list data through a query and then created a reference query with the Table.Buffer added where I do the pivots and other operations. The total refresh time went down from 3 minutes to around 18 seconds, which is quite nice.
Regards,
Matt
- Matthias939 years ago
Helper III
Hi,
After some more testing I find that my referenced query is not at all being updated based on the source query. I disabled my referenced query from refreshing too make the refreshing on the report faster. It does not work with or without the Table.Buffer function in front of the referenced query.
Do any of you know what I can do to make this work, I'm getting quite frustrated with it.
Regards,
Matt