Dataflow: Cannot write more bytes to the buffer than the configured maximum buffer size

[luizzed]

Hi,

I have a power bi dataflow that performs transformations of an entity from another dataflow (over 20 millions rows). But I can't update the data, the following error happens: "Cannot write more bytes to the buffer than the configured maximum buffer size: 214783647"

I read a bit about containers size, I believe the problem is there. How can I get around this?

Best Regards

[luizzed]

Hi @v-luwang-msft , Thanks for the answer. This question you posted refers to power bi desktop, but my problem happens in the power bi service, when i try to update the data from a dataflow.

[v-luwang-msft]

Hi @luizzed ,

Similar questions I have seen in a number of places:

Q:I’ve experienced similar issues to some of the commenters, where loading data with the new Dataflows connector via PowerBI desktop does not even complete for me.

I have about 20 million rows and after 20 minutes of attempting to connect to PowerPlatformDataflows, I receive “An error happened while reading data from the provider: ‘Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647’. I attempted restricting the data with RangeStart and Range end parameters, but even one day of data times out.

A:The error “Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647” is a known issue in the August release of Power BI Desktop and the fix will be available in the September release.

And refer:

How Query Folding And The New Power BI Dataflows Connector Can Help Dataset Refresh Performance

Did I answer your question? Mark my post as a solution!

Best Regards

Lucien

[arvindsingh802]

Are you using Premium Gen 2, if not you can Configure Power BI Premium dataflow workloads - Power BI | Microsoft Docs

[luizzed]

I have a Premium Gen 2, so there isn't Workloads for Dataflows, only datasets..

[arvindsingh802]

That's what I was also thinking,

Please conatct Support | Microsoft Power BI they will be able to update the details