Table creation in lakehouse with schema

schou — Thu, 29 Aug 2024 19:35:29 GMT

Hello,

I had a schema-enforced lakehouse and tried to create a table with Pyspark. Code as below:

df.write.mode("overwrite").option("overwriteSchema", "true").format("delta").saveAsTable("schema.table")

But returned the error like this: An error occurred while calling o4724.saveAsTable. : java.lang.RuntimeException: Request failed: HTTP/1.1 403 Forbidden

I am able to use the same code to create a table in a non schema lakehouse.

My account have write permission to both lakehouses.

Does anyone has insight of it?

Thank you!!

Re: Table creation in lakehouse with schema

Anonymous — Fri, 30 Aug 2024 06:54:42 GMT

Hi schou ,

As far as I know this error message occurs due to architectural mismatch occurs .

You can try using the following syntax:

df = spark.read.format(“csv”).option(“header”, “false”).load( “Files/2019.csv") # Create a new table df.write.format(“delta”).saveAsTable(“test2”)

If the above syntax doesn't take effect, you may want to consider leaving this message unchecked, as checking it may cause the system to apply more stringent checks to the data being written

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

topic Re: Table creation in lakehouse with schema in Developer

Table creation in lakehouse with schema

Re: Table creation in lakehouse with schema