What to do if file size exceeds 1 GB in Power BI?

[Anonymous]

Hi All

I am using Import mode and the source is SQL Server , as of now just loaded 3 tables and my file size is exceeding 1 GB.

Please suggest the ways of dealing with high volumes of data if dont want to use Direct Query.

I am a Pro user.

Thanks !

Ankita

[HotChilli]

You should get the design right first - a star schema with fact and dimension tables.  

The Fact table should (as much as possible) be only numeric fields.

Decide on the appropriate granularity for the Fact table -  there may be no need to report on the level of detail from the source database .  Powerbi is all about aggregations.

[HotChilli]

pbix file size on disk exceeds 1GB?   or memory when file is in use exceeds 1GB?

[Anonymous]

Hi

Thanks for response.

pbix file size on disk is exceeding 1 gb.

[V-lianl-msft]

Hi @Anonymous ,

Based on the above method, you also need to use incremental refresh to reduce overall consumption of memory and other resources.

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh 

https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only 

Best Regards,
Liang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[amitchandak]

@Anonymous , refer these

https://docs.microsoft.com/en-us/power-bi/guidance/import-modeling-data-reduction

https://towardsdatascience.com/how-to-reduce-your-power-bi-model-size-by-90-b2f834c9f12e

[Anonymous]

Thanks for sharing these ideas, however I have tried my best to use these tips as much as possible, the main challenge I have is the data is lot and source is SQL Server, I am even creating a view to fetch just the columns that are required , to avoid relationships in Power BI and not loading any redundant or extra column.

As of now just loaded 3 tables but need to load as many as 10 tables, each table having more than 20 Lakh record some even have more than 2 crore rows.

So basically what is the best way to work with the sources having huge volumes of data.

Thanks!

[amirthaP]

Hi, I'm facing the same issue, is there any method you can suggest other than direct query, to import the data to powerbi, offline from s3, I'm not able to load more than 1GB