Forum Discussion

schou's avatar
schou
Frequent Visitor
2 years ago
Solved

Table creation in lakehouse with schema

Hello,

 

I had a schema-enforced lakehouse and tried to create a table with Pyspark. Code as below:

df.write.mode("overwrite").option("overwriteSchema", "true").format("delta").saveAsTable("schema.table")
 
But returned the error like this: An error occurred while calling o4724.saveAsTable. : java.lang.RuntimeException: Request failed: HTTP/1.1 403 Forbidden
 
I am able to use the same code to create a table in a non schema lakehouse.
My account have write permission to both lakehouses.
 
Does anyone has insight of it?
 
Thank you!!
 
Need Help
Tips and Tricks
Tutorial Requests
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi schou  ,

     

    As far as I know this error message occurs due to architectural mismatch occurs .

    You can try using the following syntax:

    df = spark.read.format(“csv”).option(“header”, “false”).load( “Files/2019.csv")
# Create a new table
df.write.format(“delta”).saveAsTable(“test2”)

    If the above syntax doesn't take effect, you may want to consider leaving this message unchecked, as checking it may cause the system to apply more stringent checks to the data being written

     

     

    Best Regards,

    Liu Yang

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

1 Reply

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi schou  ,

     

    As far as I know this error message occurs due to architectural mismatch occurs .

    You can try using the following syntax:

    df = spark.read.format(“csv”).option(“header”, “false”).load( “Files/2019.csv")
# Create a new table
df.write.format(“delta”).saveAsTable(“test2”)

    If the above syntax doesn't take effect, you may want to consider leaving this message unchecked, as checking it may cause the system to apply more stringent checks to the data being written

     

     

    Best Regards,

    Liu Yang

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.