Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Syndicate_Admin
Administrator
Administrator

Power Query Slow Refresh - Many Record and Table

Hi!
I have 2 queries, which both have Record and table.
Both queries will be appended after each query record and table are extracted.

The problem is, I feel like the query refresh very slow, even when i only have few data.
I do sort and filter first for each data to make data iteration faster since only small amount of row data will be extracted, but nothing happens.
Any idea?

 

 

1 ACCEPTED SOLUTION

You are right. Expanding data from SP or any other Web Based service may require HTTP request for each row. which could lead to slow performance. The more rows you have, the more HTTP requests are made which can be inefficient. 

 

I suggested Table.Buffer() thinking as this function, according to Microsoft creates an in-memory snapshot of your current table. I thought it could improve the refresh rate a little bit. Although the below thread, says this function doesn't always improve performance. 

 

you can go through this thread to know more about table.buffer().

 

From the official doc of Table.Buffer() from my previous comment, your code might look like,

 

let
    Source = ... (your SP data source code here),
    BufferedSource = Table.Buffer(Source),
    ExpandedData = ... (your expansion or other operations on BufferedSource)
in
    ExpandedData

 

https://www.myonlinetraininghub.com/excel-forum/power-query/how-to-use-table-buffer-please-help

 

rubayatyasmin_0-1689517080227.png


Did I answer your question? Mark my post as a solution!super-user-logo

Proud to be a Super User!


View solution in original post

3 REPLIES 3
Syndicate_Admin
Administrator
Administrator

Hi!
I'm still new with power query.
and after looking for some information, I get that the problem is expanding from another sharepoint requires http request for each row right?

but that's all I know,
i know nothing about Table.buffer even after learning it

You are right. Expanding data from SP or any other Web Based service may require HTTP request for each row. which could lead to slow performance. The more rows you have, the more HTTP requests are made which can be inefficient. 

 

I suggested Table.Buffer() thinking as this function, according to Microsoft creates an in-memory snapshot of your current table. I thought it could improve the refresh rate a little bit. Although the below thread, says this function doesn't always improve performance. 

 

you can go through this thread to know more about table.buffer().

 

From the official doc of Table.Buffer() from my previous comment, your code might look like,

 

let
    Source = ... (your SP data source code here),
    BufferedSource = Table.Buffer(Source),
    ExpandedData = ... (your expansion or other operations on BufferedSource)
in
    ExpandedData

 

https://www.myonlinetraininghub.com/excel-forum/power-query/how-to-use-table-buffer-please-help

 

rubayatyasmin_0-1689517080227.png


Did I answer your question? Mark my post as a solution!super-user-logo

Proud to be a Super User!


rubayatyasmin
Super User
Super User

Hey, 

 

you can try to use Table.Buffer() to solve this problem. 

 

I found a similar thread that might be of help. 

 

https://community.fabric.microsoft.com/t5/Power-Query/Power-Query-taking-forever-to-load-or-refresh/....

 

rubayatyasmin_0-1689517080227.png

 


Did I answer your question? Mark my post as a solution!super-user-logo

Proud to be a Super User!


Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Kudoed Authors