Forum Discussion
Kryo serialization exception
Hi @Nape ,
I understand that you have tried reducing the size of the object you are trying to serialize, but this has not resolved the issue.
FYI: For faster serialization and deserialization spark itself recommends to use Kryo serialization.
I have a few additional suggestions for you, can you please try to refer the below links -
Kryo Serialization in Spark - Knoldus Blogs
Apache Spark: All about Serialization | by Jay | SelectFrom
8 Performance Optimization Techniques Using Spark - Syntelli Solutions Inc.
Troubleshooting Spark Issues — Qubole Data Service documentation
Hope this helps in resolving your issue.
Thank you
We tried to reduce the size of the object but it did not work. Do you have any examples on serializing the underlying RDD or any other serializer?
Hi @Nape ,
I understand that you have tried reducing the size of the object you are trying to serialize, but this has not resolved the issue.
FYI: For faster serialization and deserialization spark itself recommends to use Kryo serialization.
I have a few additional suggestions for you, can you please try to refer the below links -
Kryo Serialization in Spark - Knoldus Blogs
Apache Spark: All about Serialization | by Jay | SelectFrom
8 Performance Optimization Techniques Using Spark - Syntelli Solutions Inc.
Troubleshooting Spark Issues — Qubole Data Service documentation
Hope this helps in resolving your issue.
Thank youHi Nape ,
Glad to know that your query got resolved.
Please continue using Fabric Community for help regarding your issues.