Forum Discussion

Naveen-004's avatar
Naveen-004
Frequent Visitor
2 years ago
Solved

Notebook fails to write data to a Delta table

Code: df.write.format("delta").mode("overwrite").option("mergeSchema", "true").save(delta_table_path) Error: Py4JJavaError: An error occurred while calling o29386.save. : org.apache.spark.SparkE...
data engineering
lakehouse
notebook
  • richbenmintz's avatar
    richbenmintz
    2 years ago

    Hi Naveen-004,

    Are you able to share all the Code in your Notebook, Spark is a lazily evaluated there could be issues in earlier commands that are only getting executed when you try to write the dataframe.