Forum Discussion
Solution SagePower Premium maximum total size dataset
Hey andhiii079845 ,
there is a storage limit of 100TB per capacity. Here you will find the article: https://learn.microsoft.com/en-us/power-bi/admin/service-admin-manage-your-data-storage-in-power-bi?wt.mc_id=DP-MVP-5003068
Hopefully, this is answering your question.
Regards,Tom
Hey andhiii079845 ,
it is possible when you turn the large dataset switch on (https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-large-models), and start using incremental refresh.
The limit that comes with P[x] capacity is per each dataset, of course it's not possbile that two large datasets (assuming 18GB each) are in memory at the same time when on P1.
The Power BI Service is very capable in managing it's resources, by evicting datasets from memory when they become outdated and reloading datasets when required.I recommend reading these articles:
- https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-what-is?WT.mc_id=DP-MVP-5003068
- https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-architecture?WT.mc_id=DP-MVP-5003068
Hopefully, this will finally help to answer all your questions.
Regards,
Tom
Super UserHey andhiii079845 ,
the nature of a Power BI dataset in import mode (data is imported to the dataset) is that the data will reside in memory when the data is queried, meaning a user is interacting with the data. The reason fo this is simple: the analytical engine behind the power of a Power BI dataset is an in-memory columnar storage engine, also known as vertipaq engine, SSAS Tabular.
If the dataset is refreshed the data has to be in memory as well, the amount of required memory can be reduced when you are using incremental refresh.
Hopefully, this provides the additional information you are looking for.
Regards,
Tom
Solution SageYes, this clear for me. But is this 50 % rule right? If I refresh the complete dataset it has to be in the memory. But also the old dataset has in the memory in this moment of refresh? So if i have 25 GB memory my maximum dataset size is 12,5 GB ?
- TomMartens
- andhiii079845
Thank you for your reply. So, it is not possible to have 4 15GB Datasets, in total 60 GB (25GB memory in total) with Importmode? Is this right? I have to use hybrid table for example or direct query
- TomMartens
Hey andhiii079845 ,
it is possible when you turn the large dataset switch on (https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-large-models), and start using incremental refresh.
The limit that comes with P[x] capacity is per each dataset, of course it's not possbile that two large datasets (assuming 18GB each) are in memory at the same time when on P1.
The Power BI Service is very capable in managing it's resources, by evicting datasets from memory when they become outdated and reloading datasets when required.I recommend reading these articles:
- https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-what-is?WT.mc_id=DP-MVP-5003068
- https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-architecture?WT.mc_id=DP-MVP-5003068
Hopefully, this will finally help to answer all your questions.
Regards,
Tom