Forum Discussion
Queries related to data size in Power Query Editor
- 1 year ago
Thankyou, jennratten, karansingla0311, for your response.
Hi coolsandeee,We appreciate your inquiry on the Microsoft Fabric Community Forum.
Based on my understanding, Power Query Editor does not have a fixed row limit. The limit depends on the available system memory (RAM) and whether you are using a 64-bit or 32-bit version. For Power BI Desktop and On-Premises Data Gateway, the data size you can load and process depends on the RAM and available virtual memory on your machine.
The error message, "Evaluation ran out of memory and can't continue," indicates that the transformation—particularly the unpivot operation—exceeded the available memory during refresh. This is more likely to occur with large datasets (for example, 1 million rows) and when multiple refreshes run in parallel on a gateway machine with 16 GB RAM.
Kindly follow the steps below, which may help resolve the issue:
- Optimize query steps by moving memory-intensive operations such as unpivoting upstream (at the source system or Power BI Dataflows). Reduce the dataset size before applying transformations by filtering or removing unnecessary columns.
- Avoid running multiple heavy refreshes simultaneously on the same gateway.
- Use Performance Monitor to check memory and CPU usage during refresh.
- Consider increasing the Gateway RAM to 32 GB or more if you frequently run concurrent heavy refreshes.
If you find our response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar issues.
Thank you.
Hello coolsandeee -
Power Query limitations can vary based on different factors like the amount of virtual memory available, the software version being utilized, etc. For example, the 64 bit version's limitation usually corresponds to the amount of virtual memory available while the 32 bit version is somewhere around 1 gb depending on the data stream. There are also things to consider like the persistent cache and query editor preview. Here is a link to more documentation on Power Query limitations.
The model does have separate limitations which do relate to the RAM of the desktop (if running PowerBI desktop) or the gateway (if refreshes are running through a gateway). The software version is also one of the factors. Here is a link to the documentation for the model limitations.
Please let me know if you have any other questions.