Re: Dataflow: Cannot write more bytes to the buffe...

luizzed · ‎01-11-2022

Hi,

I have a power bi dataflow that performs transformations of an entity from another dataflow (over 20 millions rows). But I can't update the data, the following error happens: "Cannot write more bytes to the buffer than the configured maximum buffer size: 214783647"

I read a bit about containers size, I believe the problem is there. How can I get around this?

Best Regards

luizzed · ‎01-17-2022

Hi @v-luwang-msft , Thanks for the answer. This question you posted refers to power bi desktop, but my problem happens in the power bi service, when i try to update the data from a dataflow.

v-luwang-msft · ‎01-13-2022

Hi @luizzed ,

Similar questions I have seen in a number of places:

Q:I’ve experienced similar issues to some of the commenters, where loading data with the new Dataflows connector via PowerBI desktop does not even complete for me.

I have about 20 million rows and after 20 minutes of attempting to connect to PowerPlatformDataflows, I receive “An error happened while reading data from the provider: ‘Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647’. I attempted restricting the data with RangeStart and Range end parameters, but even one day of data times out.

A:The error “Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647” is a known issue in the August release of Power BI Desktop and the fix will be available in the September release.

And refer:

How Query Folding And The New Power BI Dataflows Connector Can Help Dataset Refresh Performance

Did I answer your question? Mark my post as a solution!

Best Regards

Lucien