Power BI Desktop using a LOT of RAM

[qmestu]

Hi,

I've been struggling the past few days with loading data into my dashboard that mostly consists of JSON coming from web apis. I have a few helper excel files but these have always worked. I cannot refresh the data and if i try to load it, an hour or so later i get an error of out of memory, which the task manager also reports, with power bi using 95% of my ram (i have a total of 24 GB).

I've tried clearing the credentials but it didn't fix the problem. I've also disabled parallel loading and automatic relationships.

Thanks.

[qmestu · Accepted solution]

I'm replying to my own post in case someone has the same problem. One of my helper excel files misteriously generated about 900 columns filled with the null value. After going through each query, finding and cleaning this excel file, although still a bit slow, all the data is now loaded.

[Mikelytics]

Yes, sometimes this step takes a long while. As long as it runs you have to wait. I sometimes experienced that this step took a long while in the first load and when it was successfully loaded it ran fast. BUt if you then again change the ETL rules in POwer Query you have again wait for a longer time.

Are you doing transformation on the data? If yes, how much? 

Best regards

Michael

-----------------------------------------------------

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly. Appreciate your thumbs up!

@ me in replies or I'll lose your thread.

-----------------------------------------------------

LinkedIn

[qmestu]

Changing the format of one column, deleting some columns that are not required, and combining several tables into one.

[Mikelytics]

HI @qmestu 

Can you please go in the global options and 

1) clear current cache

2) increase cache available

Maybe it helps optimizing your memory

Best regards

Michael

-----------------------------------------------------

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly. Appreciate your thumbs up!

@ me in replies or I'll lose your thread.

-----------------------------------------------------

LinkedIn

[qmestu]

Same thing. Eventually the power bi app just stops responding, i can't even cancel. It's just stuck on "creating connection in model".