Dataset refresh fails to memory error

[BilboBaggins]

Some of our customer dataset refreshes started to fail last weekend. There haven't been any changes in the reports or datasets, so I'm quite confused about where to start fixing the problem. Also, the error message doesn't provide much-needed clues.

We are currently running Power BI Embedded Gen2 with A3 capacity, and this has been running smoothly. However, now after the weekend, I need to scale the capacity up to A4 to be able to refresh these datasets. So my conclusion at this time is, that there have been some changes in the Power BI backend, and the memory usage has gone up because of this.

Is there anybody else who has had the same kind of experiences lately? Any suggestions where to start tracking the problem and/or optimizing the dataset?

[arvindsingh802]

Have you migrated to Premium Gen2 if not I would suggest you to do so as this will help you What is Power BI Premium Gen2? - Power BI | Microsoft Docs

If this post helps, then please consider Accept it as the solution, Appreciate your Kudos!

[BilboBaggins]

Yes, forgot to mention that. We have been using Gen2 for several months already.

[arvindsingh802]

I would suggest to do capacity load test if you need to upscale your capacity

Power BI embedded analytics capacity planning - Power BI | Microsoft Docs

Also you can optimise your dataset follow Power BI guidance documentation - Power BI | Microsoft Docs

If this post helps, then please consider Accept it as the solution, Appreciate your Kudos!