Forum Discussion
PBI Dataset Not Refreshed Due to Reaching Memory Limit
Ensure you have Large Dataset turned on for the dataset sirahcy , and see this article. It specifically mentions a 12GB dataset in a P1 capacity might cause issues, but a 9GB may depending on what else is loaded at the time. Large datasets in Power BI Premium - Power BI | Microsoft Learn
Are you using incremental refresh? The entire dataset does not need to be loaded during refresh if you are using incremental refresh on the large fact table(s). Only those recent partitions that would refresh.Thank you edhans. Yes. We're enabled for Large dataset and incrementl refresh on the large fact tables. Some of the datasets actually approached 12GB or exceeded so we definitely will look into sizing the capacity. We're using incremental refresh (e.g. ~60% of a fact table), but not sure how much saving in memory usage, instead of 2x dataset size using full refresh.
Community ChampionI suspect it is those approaching or exceeding it that is causing the issue. May be time to move to a P2 capacity, or remove some history from the models.
We do have adhoc memory failure on P2 capacity as well. To check against the Max memory per query (6GB), do you look at the IO on the compute/cluster that processes the PBI refresh or something else?