Don't miss your chance to take the Fabric Data Engineer (DP-700) exam on us!
Learn moreWe've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now
The R for loading data is using excessive RAM.
I use R to load data onto PowerBI because I have to do some operations before hand. My system has 48 Gb RAM and its running out of RAM when data is loading.
The RAM is being used by the multiple R sessions that start on data refresh.
The same script when I run outside of PowerBI on Rstudio , it hardly uses 10% of RAM.
Please help in understanding how to solve the issue of POwerBI running weirdly multiple sessions of R and then using a lot of RAM by each of them.
Just brainstorming here, but are you doing merges with the loaded R data table(s)? You may be unintentionally reloading for each row of data. See this video by Chris Webb with GuinInACube. May be an application for Table.Buffer().
If this solution works for you, please mark it as the solution. Kudos are appreciated too. Please let me know if not.
Regards,
Pat
To learn more about Power BI, follow me on Twitter or subscribe on YouTube.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 5 | |
| 4 | |
| 3 | |
| 3 | |
| 2 |
| User | Count |
|---|---|
| 8 | |
| 8 | |
| 6 | |
| 6 | |
| 5 |