Forum Discussion

datacrawler's avatar
datacrawler
Regular Visitor
2 years ago
Solved

Power BI premium capacity memory limitation during refresh

Hi community experts,
Is there a way to ensure that you can use the full memory limit of a Power BI Premium capacity during a dataset refresh?

 

We are working on this issue: Some of our datasets have become too large to refresh with our P1 capacity and the 25GB memory limit.

 

We get this error message:
Resource Governing: This operation was canceled because there wasn't enough memory to finish running it. Either reduce the memory footprint of your dataset by doing things such as limiting the amount of imported data, or if using Power BI Premium, increase the memory of the Premium capacity where this dataset is hosted. More details: consumed memory 13812 MB, memory limit 13812 MB, database size before command execution 11787 MB

 

My understanding is that the size limits mentioned in the error message are because there is a copy of the old dataset that is held in memory during the refresh.

 

Is there a way to delete this copy of the old data during the refresh to free up this space without negatively impacting the reports, other than of course they cannot be queried during the refresh?

 

The simple solution is of course to order a larger premium capacity, but the storage limitation is the only one that concerns us. Our other usage metrics look good with the P1 capacity.

 

Any feedback is appreciated.

  • That copy of the old data is crucial in case your refresh fails. It needs to be there, but that of course means that you need twice as much memory as the size of the semantic model.

     

    The correct workaround is to implement incremental refresh and/or selective table and partition refresh.

1 Reply

  • That copy of the old data is crucial in case your refresh fails. It needs to be there, but that of course means that you need twice as much memory as the size of the semantic model.

     

    The correct workaround is to implement incremental refresh and/or selective table and partition refresh.