Forum Discussion

lavankumar1989a's avatar
lavankumar1989a
Helper II
1 year ago

Dataset Refresh Failure in PowerBI Service

Hi All,

 

We are running some PowerBi limitations while refreshing one of my large dataset. Please find the below error for your reference,

We are on Premium P3 Capacity and our dataset size is around 10.6 GB in PowerNI desktop level so was unable to publish in PowerBi service as it's giving max limit is 10GB in local desktop. So we loaded the limited data in and published the dataset into service and enabled the quarterly level partitions for my fact table and enabled the sequantial refresh using datapipeline option in fabric.

But eventhough getting above error.

 

So please provide the limitations for each dataset or symantic model size in P1, P2 & P3 capacities over the PBI service. 

1. Can we load the data beyond 10GB in PowerBi service for a single dataset?

2. If not possible kindly provide the suggestions to enable the refresh without reducing the amount of data in the tables as business needed 4 years data for their business(currently we have around 100M and it will increase to another 50M)

 

3. is there any capacity settings that we need to modify to improve the performance of queries or rendering of the reports?

 

please feel free to share your inputs that would help us to improve the quality of our operations.

 

 

Thanks,

Lavan

 

 

Need Help

6 Replies

  • lbendlin's avatar
    lbendlin
    Super User
    1 year ago

    You have hit a hard limit.  10 GB.  HOWEVER - this is not a limit of the semantic model, nor is it the limit for a table. It is the limit for a PARTITION.

     

    Solution: Switch to incremental refresh and make sure each partition stays under 10 GB.

    • lavankumar1989a's avatar
      lavankumar1989a
      Helper II
      1 year ago

      Thank you so much lbendlin for your quick response and each partition data is below 1GB when i loaded into separate .pbix files but i have a large fact table which has 120M rows along with 130 columns to be loaded and it's corssed 10GB as of now overall .pbix file is around 10.6GB.

       

      But i pulled only 1year data and published and with the help of tabuler editor connected to my model and created quarterly partitions like 16 partitions for 4 years and trying to load the data and it's not allowing me to load the data hence it's giving the error like we exceeded the limt of 10240MB.

       

      in our case incremental refresh will not work as our historical data also changes and users needed full load on daily basis. please suggest us if anyone came across to this situation. Thanks