Error occurs in processing comm message:e.statements is null

[Sidoine75]

Hello,

I'm facing the "Error occurs in processing comm message:e.statements is null" error message while running one of my multiples notebook in microsoft fabric.

the error occur in a code when i'm trying to save a dataframe as a delta partitioned table as below:

    df.write\

    .mode("overwrite")\

    .option("partitionOverwriteMode", "dynamic")\

    .saveAsTable("table_test")

table_test is a partitioned table create as below:

df1.write.mode("overwrite").option("overwriteSchema","true").partitionBy('source','client','id').format('delta').saveAsTable('table_test')

i don't have any idea how to investigate.

Anyone here has already face this issue?

thanks for help.

sidoine.

[Sidoine75]

hello,

thanks for taking time to reply.

I have followed the above link "PySpark — Dynamic Partition Overwrite | by Subham Khandelwal | Medium" but the same error is occuring and i'm stucking with the same issue with additional Error message as below in attachment.

[Anonymous]

Hi @Sidoine75 ,

Apologize for the issue you are facing. The best course of action is to open a support ticket and have our support team take a closer look at it.

Please reach out to our support team so they can do a more thorough investigation on why this it is happening: Link 

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Hope this helps. Please let us know if you have any other queries.

[Sidoine75]

Hello all,

I'm still facing the issue and a ticket has been already created to Microsoft support with the tracking ID 2405280050001601

Regards.

Sidoine.

[Anonymous]

Hi @Sidoine75 ,

Thanks for sharing the support ticket.

Please allow some time, so team can check and provide a resolution.

In case if you got a resolution please do share with the community as it can be helpful to others .

[Anonymous]

Hi @Sidoine75 ,

Thanks for using Fabric Community.

Can you please refer below Doc -

PySpark — Dynamic Partition Overwrite | by Subham Khandelwal | Medium

Hope this is helpful. Please do let me know incase of further queries.

[Anonymous]

Hello @Sidoine75 ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
Otherwise, will respond back with the more details and we will try to help .