Forum Discussion
Cannot Remove Invalid Table "_delta_log._commits" — SQL Sync Blocked
Hi Antongig
Somewhere you deleted the transaction log file or data is corrupted due to _delta_log. For that, you need to delete the whole table ( single table ) and recreate the table using Python or scala commands which ever you think is relevant.
Also, Which database are you using as a source. I mean to say Azure SQL. SQL Server...etc.
Super UserHi Antongig
Somewhere you deleted the transaction log file or data is corrupted due to _delta_log. For that, you need to delete the whole table ( single table ) and recreate the table using Python or scala commands which ever you think is relevant.
Also, Which database are you using as a source. I mean to say Azure SQL. SQL Server...etc.
The Lakehouse uses Delta Lake format underneath on OneLake storage.
I already tried deleting and recreating the table, but Fabric’s SQL sync still reports _delta_log._commits as a table, even though it doesn’t exist anymore. I tried:
spark.sql("DROP TABLE IF EXISTS Silver_Lakehouse.`_delta_log._commits`")and I also tried:
tables_path = "/lakehouse/default/Tables"
for i in os.listdir(tables_path):
if "commits" in i:
print(i)in my notebook in fabric. Both does absolutely nothing.
v-menakakotaCommunity Support
Hi Antongig ,
Since the table cannot be removed through Spark, file APIs, or SQL commands and it’s impacting downstream workloads it’s best to open a support request with Microsoft Fabric Support.
Please refer below link on how to raise a contact support or support ticket.
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn
Regards,
Community Support Team.- v-menakakota
Hi Antongig ,
We’d like to follow up on your support ticket. Has the issue been successfully addressed?
If a solution was provided, we’d truly appreciate it if you could share your experience or any relevant details, your input could be valuable to other community members.
Thanks again for being an active part of the Microsoft Fabric Community!
Hey, I am trying to remove the table with rest api as you posted below. If that does not work I will open a support ticket, since microsoft support costs money it will be the last straw.
Thanks