Forum Discussion

ACSpotlight's avatar
ACSpotlight
Regular Visitor
1 year ago

Exceed Memory on Refresh

Hi I have a P1 Power Bi Premium capacity and the data set I am importing has a fact table coming from Snowflake that is 5GB with about 230m rows and 16 columns (3 years of data).  The dim tables of w...
Need Help
pankajnamekar25's avatar
pankajnamekar25
Super User
1 year ago

Hello ACSpotlight 

You're hitting a memory error on refresh in Power BI Service (P1 capacity) after increasing your dataset from 1 month to 3 years. The model exceeds the 25GB per dataset memory limit during processing.

Suggestions

Optimize Power Query steps (remove unused columns early)

Push aggregations to Snowflake

Implement Incremental Refresh to limit data loaded

Monitor memory usage via Premium Metrics app

Split large model into smaller parts or use dataflows

 

 

 

Thanks

 Pankaj Namekar | LinkedIn

If this solution helps, please accept it and give a kudos (Like), it would be greatly appreciated.

  • ACSpotlight's avatar
    ACSpotlight
    Regular Visitor
    1 year ago

    Hi Pankaj,  Thankyou for your suggestions.  I removed a couple of columns from the fact table that were only nice to haves.  This reduced the table from 5gb to 4.2gb.  I then filtered the date period down to 2 years which reduces it to 2.8gb.  Finally I created a copy of this and removed all my dax calculations so only the source tables are in the model file.  I then published that and refreshed it and am still getting the same error.  I don't understand how I am hitting the 25gb limit when i am only refreshing about 2.8gb of data.