topic Re: Cannot create delta table in lakehouse in Data Engineering

Cannot create delta table in lakehouse

AdilH — Thu, 29 Feb 2024 10:56:44 GMT

All,

We have a fabric capacity in West-europe and since this morning we cannot create delta tables in lakehouse(existing)

The error message is : "Create database for <<Lakehouse>> is not permitted using Apache Spark in Microsoft Fabric."

This was working until yesterday(same script)

Do you know if this a region issue? or am I missing something?

Thanks!

Re: Cannot create delta table in lakehouse

Anonymous — Thu, 29 Feb 2024 11:15:22 GMT

Hi AdilH ,

Thanks for using Fabric Community.
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

Re: Cannot create delta table in lakehouse

AdilH — Thu, 29 Feb 2024 11:17:19 GMT

Thanks, I look forward to your response.

Re: Cannot create delta table in lakehouse

AdilH — Thu, 29 Feb 2024 20:31:14 GMT

Hi Anonymous,

Do you have any update on this?

Re: Cannot create delta table in lakehouse

AdilH — Thu, 29 Feb 2024 21:50:08 GMT

Hi,

I realize, also running just the select statement on the delta table results in the same error. Exact same query was working a day before.

Support page shows no issues in West europe region.

I am afraid the product doesnt seem to be stable even in GA.

Re: Cannot create delta table in lakehouse

Anonymous — Fri, 01 Mar 2024 04:40:56 GMT

Hi AdilH ,

Are they trying to create a table or database?
Can you please share your script if possible or explain what you are trying to do?

Re: Cannot create delta table in lakehouse

AdilH — Fri, 01 Mar 2024 08:04:44 GMT

Script :

from pyspark.sql.types import *

from delta.tables import *

DeltaTable.createIfNotExists(spark).tableName("test_2") \

.addColumn("start_ts",TimestampType()) \

.addColumn("end_ts",TimestampType()) \

.addColumn("last_update_ts",TimestampType()) \

.addColumn("column1",IntegerType()) \

.addColumn("column2",IntegerType()) \

.addColumn("column3",IntegerType()) \

.addColumn("column4",IntegerType()) \

.addColumn("column5",DateType()) \

.addColumn("column6",DateType()) \

.addColumn("column7",IntegerType()) \

.addColumn("column8",IntegerType()) \

.addColumn("column9",IntegerType()) \

.addColumn("column10",IntegerType()) \

.addColumn("column11",IntegerType()) \

.addColumn("column12",IntegerType()) \

.addColumn("action",StringType()) \

.partitionedBy("column1")\

.execute()

Re: Cannot create delta table in lakehouse

AdilH — Fri, 01 Mar 2024 08:06:11 GMT

Error message : "Py4JJavaError: An error occurred while calling o299.sql. : org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Create database for "Lakehouse" is not permitted using Apache Spark in Microsoft Fabric.)"

Re: Cannot create delta table in lakehouse

AdilH — Fri, 01 Mar 2024 08:06:54 GMT

It gives the same error even if I just run a select on the existing table

Re: Cannot create delta table in lakehouse

Anonymous — Fri, 01 Mar 2024 15:19:29 GMT

Hi AdilH ,

Just want to check have you detached any lakehouse or the attached lakehouse was deleted?

Re: Cannot create delta table in lakehouse

AdilH — Fri, 01 Mar 2024 18:18:16 GMT

No, none of this

Re: Cannot create delta table in lakehouse

Anonymous — Sat, 02 Mar 2024 09:10:40 GMT

Hi AdilH ,

Internal Team suggest to open a support ticket.

Please reach out to our support team so they can do a more thorough investigation on why this it is happening: Link

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Hope this helps. Please let us know if you have any other queries.

Re: Cannot create delta table in lakehouse

Anonymous — Tue, 05 Mar 2024 04:49:52 GMT

Hello AdilH ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance to create a support ticket.
After creating a Support ticket please provide the ticket number as it would help us to track for more information.