Forum Discussion
1GB Limit Explained
Just to expand and clarify on Q1.
When you click "close and apply" the data is stored in RAM. When you click SAVE to save your pbix file the data from RAM is written into the .pbix file (and conversely loading a PBIX reads the all data from disk and loads it into RAM). Technically you will also see some temp files used when you click "close and apply", but those are never permanently stored anywhere.
Note that the size of the data stored inside the pbix file is likely to be slightly smaller than the memory footprint as there are some objects like dictionaries that are stored uncompressed in memory, but have additional compression applied when writing them to disk. And your pbix includes the metadata for your report visuals (the blog Frank linked to breaks down the structure of a pbix file).
Hi Anonymous ,
Q1.
For import, all the data are stroed on premise. So it is safe to say that all the data are stored in disk. You can refer to the bolg to know about what makes up a pbix to help you understand that.
Q2.
Also the blog , that means the file size should not be more that 1 GB. So this mean 1GB to disk.
Regards,
Frank
Hi v-frfei-msft ,
Thank you for the reply.
In regards to Q1) I understand that loading data using the connectivity type Import, loads on premise. The article you shared is helpful in understanding what exactly gets stored to disk. The curiosity was around how does this play with the RAM. But this was answered below by d_gosbell when mentioning that when you initiate a PBIX file the data gets stored to memory and when closing the PBIX file it gets cleared from memory and so on.
In regards to Q2) I always made the assumption it was Disk and not Memory that gets consumed in the Cloud. However, going back to what d_gosbell mentioned below, is it correct to say after we publish a PBIX file to the Power BI Service, yes the storage on Disk is what gets consumed as part of the 1GB limit, but other factors regarding Memory need to be taken into consideration. For instance, i recently pubclihsed a PBIX file less then 1GB, yet i got a Memory Exceeded limit error on a single visuailiation. Would you know any other good articles that highlight other data limitations in a PBIX file?
Thanks,
Laz
> For instance, i recently pubclihsed a PBIX file less then 1GB, yet i got a Memory Exceeded limit error on a single visuailiation
This could be a different memory limit. From memory I think they have some sort of "per query" memory limit on the service to prevent a single visual from consuming too much memory. It's possible that you may have one or more measures that due to the way they are coded need to create materialized temp tables.
Marco Russo did a great demo on using DAX Studio to capture and tune slow running queries here https://www.youtube.com/watch?v=B-h3Pohtn1Y you could use the same technique, but keep an eye on Task Manager to get a rough idea of how much memory your query uses (Marco does show this during his video)
HI d_gosbell
Yes, the visual was consuming too much memory ad an individual query.
This was due to using a SUMX in a way that made it consume too much data, especially as the SUMX works on a row by row basis. Full details if interested here:
https://community.powerbi.com/t5/Desktop/SUMX-Too-Slow-Solution-is-SUMMARIZE/m-p/627654#M299865
Resolved this by using SUMMARIZE.
I will be certain to view the below video so big thank you for sharing! i saw that floating around and its time i view it.
Laz