DataflowsError

[ArvindJha]

Hello all,

Getting the error when running Dataflow , it seems because of data size , how to resolve the error?

Error: PipelineException: The uncompressed data size specified in a packet header exceeds max limit: GatewayDecompressor - Header.UncompressedDataSize (211517212) of a compressed packet exceeds the maximum allowed uncompressed payload of 157286421..Param1 = PipelineException: The uncompressed data size specified in a packet header exceeds max limit: GatewayDecompressor - Header.UncompressedDataSize (211517212) of a compressed packet exceeds the maximum allowed uncompressed payload of 157286421 

[v-mdharahman]

Hi @ArvindJha,

Thanks for reaching out to the Microsoft fabric community forum.

It looks like you are facing issue whike running your dataflow and you suggest it might be because of data size. As @rajendraongole1 already responded to your query, please go through his response and mark it as solution if it solves your issue.

I would also take a moment to thank @rajendraongole1, for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

Best Regards,
Hammad.
Community Support Team

If this post helps then please mark it as a solution, so that other members find it more quickly.

Thank you.

[v-mdharahman]

Hi @ArvindJha,

As we haven’t heard back from you, so just following up to our previous message. I'd like to confirm if you've successfully resolved this issue or if you need further help.

If yes, you are welcome to share your workaround and mark it as a solution so that other users can benefit as well. If you find a reply particularly helpful to you, you can also mark it as a solution.

If you still have any questions or need more support, please feel free to let us know. We are more than happy to continue to help you.
Thank you for your patience and look forward to hearing from you.

[v-mdharahman]

Hi @ArvindJha,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution so that other community members can find it easily.

Thank you.

[v-mdharahman]

Hi @ArvindJha,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[rajendraongole1]

Hi @ArvindJha  - These errors are common when there is a data packet being processed in your Power BI Dataflow exceeds the maximum allowed size

Try limiting the number of rows or columns processed in your Dataflow:

Try reducing columns, filtering data, and enabling Incremental Refresh first. If the issue persists, check gateway memory and consider partitioning your data.

option 2: If possible, split large tables into smaller tables and process them separately

ref: link:

Troubleshooting Dataflows in Power BI | Power Query Tutorial Ep8 | Power BI | BI Consulting Pro | 4K

https://community.fabric.microsoft.com/t5/Service/PipelineException-when-running-dataflow-Compressed...

[ArvindJha]

Thanks for the response all of this is already taken care of still the issue persists , for incremental load to happen it has to do full load first time right ? colums are reduced to what is required , it works absoultely fine in QlikSense