Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago
Solved

Power BI Not Loading ~45 Million Rows

I'm trying to import a fact table with ~45 million rows, and the import chokes at around 5GB (45 minutes).    I've already trimmed down columns, avoided text strings, aggregated, etc. to help the l...
Need Help
  • Anonymous's avatar
    Anonymous
    6 years ago

    Hi Nathan,

    I wonder if you could benefit by using DirectQuery instead of loading all of your data. Note that you design your model to be Dual mode. Some tables to be in-memory(load all data) and others using DirectQuery.

     

    Please read the following regarding dataset sizes:

    https://docs.microsoft.com/en-us/power-bi/service-premium-what-is

    Large datasets

    Depending on the SKU, Power BI Premium supports uploading Power BI Desktop (.pbix) model files up to a maximum of 10 GB in size. When loaded, the model can then be published to a workspace assigned to a Premium capacity. The dataset can then be refreshed to up to 12 GB in size.

    Size considerations

    Large datasets can be resource-intensive. You should have at least a P1 SKU for any datasets larger than 1 GB. Although publishing large datasets to workspaces backed by A SKUs up to A3 could work, refreshing them will not.

    The following table shows the recommended SKUs for .pbix file upload or publish to the Power BI service:

    SKU Size of .pbix
    P1< 3 GB
    P2< 6 GB
    P3, P4, P5up to 10 GB

     

    let me know if this helps or not.

    Tomas

     

Anonymous's avatar
Anonymous
Not applicable
6 years ago

Hi Nathan,

I wonder if you could benefit by using DirectQuery instead of loading all of your data. Note that you design your model to be Dual mode. Some tables to be in-memory(load all data) and others using DirectQuery.

 

Please read the following regarding dataset sizes:

https://docs.microsoft.com/en-us/power-bi/service-premium-what-is

Large datasets

Depending on the SKU, Power BI Premium supports uploading Power BI Desktop (.pbix) model files up to a maximum of 10 GB in size. When loaded, the model can then be published to a workspace assigned to a Premium capacity. The dataset can then be refreshed to up to 12 GB in size.

Size considerations

Large datasets can be resource-intensive. You should have at least a P1 SKU for any datasets larger than 1 GB. Although publishing large datasets to workspaces backed by A SKUs up to A3 could work, refreshing them will not.

The following table shows the recommended SKUs for .pbix file upload or publish to the Power BI service:

SKU Size of .pbix
P1< 3 GB
P2< 6 GB
P3, P4, P5up to 10 GB

 

let me know if this helps or not.

Tomas