Forum Discussion

Naveen-004's avatar
Naveen-004
Frequent Visitor
2 years ago
Solved

Notebook fails to write data to a Delta table

Code: df.write.format("delta").mode("overwrite").option("mergeSchema", "true").save(delta_table_path) Error: Py4JJavaError: An error occurred while calling o29386.save. : org.apache.spark.SparkE...
data engineering
lakehouse
notebook
  • richbenmintz's avatar
    richbenmintz
    2 years ago

    Hi Naveen-004,

    Are you able to share all the Code in your Notebook, Spark is a lazily evaluated there could be issues in earlier commands that are only getting executed when you try to write the dataframe.

richbenmintz's avatar
richbenmintz
Resident Rockstar
2 years ago

Hi Naveen-004,

Are you able to share all the Code in your Notebook, Spark is a lazily evaluated there could be issues in earlier commands that are only getting executed when you try to write the dataframe.

  • Naveen-004's avatar
    Naveen-004
    Frequent Visitor
    2 years ago

    Thanks for your help in finding the issue.

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Microsoft Employee
      2 years ago

      Hi Naveen-004 

       

      Glad that your query got resolved.
      Please continue using Fabric Community for further queries.

       

      Thank you.