Forum Discussion
write_deltalake with Python Notebook is creating an "Unidentified" folder in my lakehouse.
- 1 year ago
Hello joshuaking
Here is what I am thinking could happened.
when writing a Delta table using Python functions like `write_deltalake` or Polars’ `write_delta`, the underlying data files are correctly created and queryable, yet the lakehouse metadata may not recognize or register the table properly. This can lead to the table being shown under an “Unidentified” folder
Writing data to a specific path does not always automatically update the lakehouse catalog.
try using ddl command like in your notebook
`CREATE TABLE student USING DELTA LOCATION '/lakehouse/your_schema/your_path/student';`
to inform the system about the logical table nameif this helps please accept the solution and give kudos
- 1 year ago
Yes it is automatic in Fabric
When files in Delta format (Parquet + `_delta_log` folder) are placed in the managed area of a Lakehouse, Fabric automatically registers them as tables in the catalog.
In most thr cases properly structured delta file from Unidentified folder eventually moves to Table
Hi joshuaking,
Thanks for reaching out to the Microsoft fabric community forum.
As nilendraFabric mentioned in his post, could you confirm whether it resolved your issue? Please feel free to reach out if you have any further questions. If the response addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thankyou.
- Anonymous1 year agoNot applicable
Hi joshuaking ,
May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.
Thank you.
- Anonymous1 year agoNot applicable
Hello joshuaking ,
Could you please confirm if the issue has been resolved? It would be greatly appreciated if you could share your insights. Feel free to reach out if you have any further questions. please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thank you.
- Rags259610 months agoFrequent Visitor
When writing to delta tables in lakehouse using Python notebooks, you have to provide the full name of table, including the schema name. So if you want to register your table to `dbo`, your full path should be:
abfss://<ws>@onelake.dfs.fabric.microsoft.com/<lh>.Lakehouse/Tables/dbo/<table-name>Otherwise, it would register to an unidentified schema.- Anonymous10 months agoNot applicable
Hi Rags2596 ,
Thank you for your helpful response.