Forum Discussion
dataset limitations
Yes.. one PBIX file corresponds to one dataset. Within a dataset you can have any number of tables in it. 30M rows is considered pretty small dataset for Power BI. If you model it properly (for example check the link which v-lili6-msft shared above), you can get very good compression. I was once able to compress a 10M row dataset to 1.3MB (it had only 6-7 columns though). Lesser columns, lower distinct values in each columns, etc. help a lot with compression.
Using Power BI Pro, you get a Storage of 10GB total (can include any number of files until this limit is reached). Each dataset can have a max of 1GB.
Using Premium, you get a dedicated capcity and the storage depending on the Capacity Node you purshase (eg. P1 gives you 25GB Storage). Each dataset published in premium can be up to a maximum 10GB size. After you publish the dataset, the size can grow with every refresh. Premium allows the data set size to grow up to 12GB after it is published to Premium capacity.
1million rows limit applies to all DirectQuery sources. For Data Import the limit is 2 Billion rows at the moment.
AkhilAshok : Thanks for your response . In detail one more question .
So each power Bi will have only one data set for one PBIX right?. In dataset the tables can be n number ?. So i have tables with 30Million in SQL database .Since power bi pulls the data in compressed can you let me know by experience so much can be the dataset size?
hi, Anonymous
Considerations and Limitations
For all data sources used in the Power BI service, the following considerations and limitations apply. There are other limitations that apply to specific features, but the following list apply to the Power BI service overall:
- Dataset size limit - there is a 1 GB limit for each dataset in the Power BI service.
- Row limit - the maximum number of rows in your dataset (when not using DirectQuery) is 2 billion, with three of those rows reserved (resulting in a usable maximum of 1,999,999,997 rows); the maximum number of rows when using DirectQuery is 1 million rows.
- Column limit - the maximum number of columns allowed in a dataset, across all tables in the dataset, is 16,000 columns. This applies to the Power BI service and to datasets used in Power BI Desktop. Power BI uses an internal row number column per table included in the dataset, which means the maximum number of columns is 16,000 minus one for each table used in the dataset.
Power BI Premium supports uploads of Power BI Desktop (.pbix) files that are up to 10 GB in size. Once uploaded, a dataset can be refreshed to up to 12 GB in size.
This is the official document for you refer to:
https://docs.microsoft.com/en-us/power-bi/service-get-data
https://docs.microsoft.com/en-us/power-bi/service-premium-large-datasets
and all the tables you had imported into pbix and the calculate column and calculate table are composed of a dataset.
so each power Bi will have only one data set for one PBIX. and one data set could be used to create multiple reports.
The factors affecting the size of the dataset including the number of tables and the size of each table.
also, here is a blog to optimize your data model for you refer to:
https://www.linkedin.com/pulse/ten-techniques-optimising-memory-usage-microsoft-power-dejan-pajk
Best Regards,
Lin
Yes.. one PBIX file corresponds to one dataset. Within a dataset you can have any number of tables in it. 30M rows is considered pretty small dataset for Power BI. If you model it properly (for example check the link which v-lili6-msft shared above), you can get very good compression. I was once able to compress a 10M row dataset to 1.3MB (it had only 6-7 columns though). Lesser columns, lower distinct values in each columns, etc. help a lot with compression.
Given: Two Power BI Pro Users (No Premium tenant)
If User-A published a 700 meg data set to WorkSpace-X his total available overall memory (10 gig) is reduced by 700 meg. Now if User-B also subscribes to WorkSpace-X will his available 10 gig memory also be reduced by 700 meg since the 700 meg data set is available to him there?
