Forum Discussion
Helper IIISlow refresh of SharePoint list data
Yes, pls try that.
Fetch your raw-data in one query and then reference this query. This will create a first step like so:
Source = NameOfTheQueryWithRawData
Change that step into this:
Source = Table.Buffer(NameOfTheQueryWithRawData)
Unfortunately, there's not much informations available around performance tuning at the moment (here are some additional details: https://blog.crossjoin.co.uk/2016/11/20/referenced-queries-and-caching-in-power-bi-and-power-query/)
Responsive ResidentFollow ImkeF example. If you need more details, post your query and I'll try to point where exactly you can benefit from Table.Buffers.
As for the reason why you need to have a Buffer in place, it is almost like forcing Power Query to firstly download all of the content from SharePoint first (into the Buffer) and then perform all of the other operations.
I assum that in your case, Power Query downloads portions of the list from SharePoint and then performs some pivoting, then fetches some more data from SharePoint again, etc. This way you are wasting a lot of time on waiting, and possibly on duplicate HTTP requests to SharePoint.
Of course this explanation is worth reading if the Table.Buffer works :)
Helper IIIThanks for helping guys. I pulled in the raw list data through a query and then created a reference query with the Table.Buffer added where I do the pivots and other operations. The total refresh time went down from 3 minutes to around 18 seconds, which is quite nice.
Regards,
Matt