User Profile
jakemercer
New Member
Joined 1 year ago
User Widgets
Contributions
Re: PySpark Query on Fabric Fails with StreamConstraintsException: String Length Exceeds Maximum
Hi girishthimmaiah Thank you for your answer. Microsoft Support sent me a very similar answer. Unfortunately the trimming of the text column or the junking of the data both did not lead to the error disappearing. I got the notebook running by saving an intermediate result in a temporary table and loading it from there again. That's not so nice but for the moment I can live with it. Thanks for your help.4.6KViews0likes1CommentPySpark Query on Fabric Fails with StreamConstraintsException: String Length Exceeds Maximum
I'm encountering an error when executing a PySpark query on Fabric. The error message is: `com.fasterxml.jackson.core.exc.StreamConstraintsException: String length (20026295) exceeds the maximum length (20000000)` I've attempted several approaches to resolve this issue, including: - Configuring the string length limit (unsuccessfully) - Reducing the query size and complexity - Removing long text columns from load to avoid large string objects However, none of these solutions have worked so far. Environment: - Platform: Microsoft Fabric - Library: PySpark - Data Source: Lakehouse (Delta format) Questions: 1. Is there a way to configure Fabric to allow larger string lengths in queries? 2. Could this error be related to serialization limits in PySpark, and if so, are there workarounds? 3. Has anyone else faced a similar issue on Fabric, and what solutions have worked for you? Any insights or workarounds would be greatly appreciated!Solved4.8KViews1like5Comments
Data Privacy
Microsoft Fabric Community and Privacy
To learn more about how we manage your data, please review the Microsoft Fabric Community Data Privacy guide.