stagger table refresh

[zahlenschubser]

Is it possible to "stagger" the table load power bi does when it refreshes the dataset?

I have a bunch of large tables - which I cannot cut down to size because there's too much historical data in there - and when I refresh the data it overflows my local machine's RAM and aborts the refresh.

[Anonymous]

Hi @zahlenschubser,

Did you mean the table parallel load features? If that is the case, you can take a look at the following document:

Evaluation configuration settings for Desktop - Power BI | Microsoft Learn
Regards,

Xiaoxin Sheng

[zahlenschubser]

That's maybe the right direction, but I don't understand the math then, I think.

Normally my machine idles at about 12GB RAM used when my main pbix is open, with 32GB max, leaving 20 GB free.

The current parallel load setting is at 8 evaluations x 900 MB = 7.2 GB.

The refresh still often peaks so high that it ran into RAM issues and terminated the query.

[Anonymous]

HI @zahlenschubser,

So your scenario is more related to improve the refresh performance and reduce the system resource usage, rights?

For that scenario, I'd like to suggest you take a look at the following link about optimization guide:

Optimization guide for Power BI - Power BI | Microsoft Learn

Regards,

Xiaoxin Sheng

[zahlenschubser]

I've been doing some testing back and forth and it seems that the overflow always seems to happen when I am doing something with one of the date columns, either formatting or calculating.