Forum Discussion
write_deltalake with Python Notebook is creating an "Unidentified" folder in my lakehouse.
- 1 year ago
Hello joshuaking
Here is what I am thinking could happened.
when writing a Delta table using Python functions like `write_deltalake` or Polars’ `write_delta`, the underlying data files are correctly created and queryable, yet the lakehouse metadata may not recognize or register the table properly. This can lead to the table being shown under an “Unidentified” folder
Writing data to a specific path does not always automatically update the lakehouse catalog.
try using ddl command like in your notebook
`CREATE TABLE student USING DELTA LOCATION '/lakehouse/your_schema/your_path/student';`
to inform the system about the logical table nameif this helps please accept the solution and give kudos
- 1 year ago
Yes it is automatic in Fabric
When files in Delta format (Parquet + `_delta_log` folder) are placed in the managed area of a Lakehouse, Fabric automatically registers them as tables in the catalog.
In most thr cases properly structured delta file from Unidentified folder eventually moves to Table
Hi joshuaking,
Thanks for reaching out to the Microsoft fabric community forum.
As nilendraFabric mentioned in his post, could you confirm whether it resolved your issue? Please feel free to reach out if you have any further questions. If the response addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thankyou.
When writing to delta tables in lakehouse using Python notebooks, you have to provide the full name of table, including the schema name. So if you want to register your table to `dbo`, your full path should be:
- Anonymous10 months agoNot applicable
Hi Rags2596 ,
Thank you for your helpful response.