Forum Discussion
File size is getting double when loading from Azure blob storage to Power BI Desktop
Hello Community,
I am facing issue while loading csv file from Azure blob storage. I am reading a csv file which is around 4 GB on Azure blob storage but PBI load more than 8 GB for it.
I have checked all below:
1. My file only has one data source connected (Azure blob storage)
2. I have only one page in the PBI .pbix file
Can anyone help on it?
You know that Power BI loads certain files twice, and runs queries twice, to get to the meta data, right?
Apart from the observed doubling in network traffic, are there any other adverse effects? Did the dataset size increase accordingly or did it stay the same?
10 GB is only the limit for the initial dataset size. If you set the dataset to incremental refresh then you can grow the dataset size beyond 10 GB during subsequent refreshes.
3 Replies
You know that Power BI loads certain files twice, and runs queries twice, to get to the meta data, right?
Apart from the observed doubling in network traffic, are there any other adverse effects? Did the dataset size increase accordingly or did it stay the same?
Thank you lbendlin ,
This makes sense, the pbix file is getting compressed significantly, nothing is duplicvating just the load size is doubled which makes refresh taking longer time.
Also, Do you have idea on load size limit on power BI? I read that power BI premium support 10GB dataset size, so wanted to make sure that it isn't causing any load error in future if file load increases above 10gbs.
10 GB is only the limit for the initial dataset size. If you set the dataset to incremental refresh then you can grow the dataset size beyond 10 GB during subsequent refreshes.