Forum Discussion

luizzed's avatar
luizzed
Frequent Visitor
4 years ago

Dataflow: Cannot write more bytes to the buffer than the configured maximum buffer size

Hi,

 

I have a power bi dataflow that performs transformations of an entity from another dataflow (over 20 millions rows). But I can't update the data, the following error happens: "Cannot write more bytes to the buffer than the configured maximum buffer size: 214783647"

 

I read a bit about containers size, I believe the problem is there. How can I get around this?

 

Best Regards

5 Replies

  • v-luwang-msft's avatar
    v-luwang-msft
    Community Support

    Hi luizzed ,

    Similar questions I have seen in a number of places:

    Q:I’ve experienced similar issues to some of the commenters, where loading data with the new Dataflows connector via PowerBI desktop does not even complete for me.

    I have about 20 million rows and after 20 minutes of attempting to connect to PowerPlatformDataflows, I receive “An error happened while reading data from the provider: ‘Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647’. I attempted restricting the data with RangeStart and Range end parameters, but even one day of data times out.

    A:The error “Cannot write more bytes to the buffer than the configured maximum buffer size. 2147483647” is a known issue in the August release of Power BI Desktop and the fix will be available in the September release.

     

    And refer:

    How Query Folding And The New Power BI Dataflows Connector Can Help Dataset Refresh Performance

     

    Did I answer your question? Mark my post as a solution!


    Best Regards

    Lucien

  • luizzed's avatar
    luizzed
    Frequent Visitor

    Hi v-luwang-msft , Thanks for the answer. This question you posted refers to power bi desktop, but my problem happens in the power bi service, when i try to update the data from a dataflow.