Forum Discussion

dbeavon3's avatar
dbeavon3
Memorable Member
3 years ago

PipelineException when running dataflow. CompressedDataSize exceeds!

Another day, and another strange message from PQ online.  I was trying to refresh a PBI online dataflow, and received the following:   PipelineException: With compression algorithm the compressed d...
Need Help
dbeavon3's avatar
dbeavon3
Memorable Member
3 years ago

While trying to fix this, I get another error with a similar format.

 

This time its complaining about uncompressed sizes.

 

PipelineException: The uncompressed data size specified in a packet header exceeds max limit: GatewayDecompressor - Header.UncompressedDataSize (193364724) of a compressed packet exceeds the maximum allowed uncompressed payload of 157286421 .

 

 

  • aj1973's avatar
    aj1973
    Community Champion
    3 years ago

    Gateways and APIs have payload size limits, AWS for instance

     

    I think moving to Premium capacity could help you out.

    • dbeavon3's avatar
      dbeavon3
      Memorable Member
      3 years ago

      We are already on premium.

       

      I really wish dataflows were more user-friendly.  There should be a way to serialize arbitrary objects out there, for the sake of related entities ("computed entities").

       

      These CSV-compatibility requirements are just plain obnoxious.  There should be a way to save XML, JSON, text, and lots more.  Even binary formats like parquet would be very helpful!