Forum Discussion
Queries related to data size in Power Query Editor
- 1 year ago
Thankyou, jennratten, karansingla0311, for your response.
Hi coolsandeee,We appreciate your inquiry on the Microsoft Fabric Community Forum.
Based on my understanding, Power Query Editor does not have a fixed row limit. The limit depends on the available system memory (RAM) and whether you are using a 64-bit or 32-bit version. For Power BI Desktop and On-Premises Data Gateway, the data size you can load and process depends on the RAM and available virtual memory on your machine.
The error message, "Evaluation ran out of memory and can't continue," indicates that the transformation—particularly the unpivot operation—exceeded the available memory during refresh. This is more likely to occur with large datasets (for example, 1 million rows) and when multiple refreshes run in parallel on a gateway machine with 16 GB RAM.
Kindly follow the steps below, which may help resolve the issue:
- Optimize query steps by moving memory-intensive operations such as unpivoting upstream (at the source system or Power BI Dataflows). Reduce the dataset size before applying transformations by filtering or removing unnecessary columns.
- Avoid running multiple heavy refreshes simultaneously on the same gateway.
- Use Performance Monitor to check memory and CPU usage during refresh.
- Consider increasing the Gateway RAM to 32 GB or more if you frequently run concurrent heavy refreshes.
If you find our response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar issues.
Thank you.
Question #1:
What is the maximum size of data that a Power Query Editor can load? Does it depend on the RAM of the machine where Power BI Desktop or the On-Premises data gateway is installed? If not, kindly share the relevant documentation about the Power Query Editor's limitations.
Answer: For PowerBi Desktop maximum data size (Power Query) depends on the RAM of the local machine running your Power BI Desktop. RAM of the machine running on the On-Premises Data Gateway comes into picture when you do scheduled refreshes because the gateway temporarily loads data into memory.
Question #2:
I am guessing that the maximum size of the data that can get loaded into Power Pivot depends on the RAM of the machine where Power BI Desktop or the On-Premises data gateway is installed. Is my guess correct?
Answer: Yes, I believe your understanding is correct.. the maximum data size depends on the RAM of machine running PowerBI Desktop or datagateway
Let me know if this helps 🙂