Forum Discussion
Microsoft EmployeeCan't setup copyjob to read partitioned delta table
Solved ! Thank you for the help 🙂
Microsoft EmployeeHi !
Thank you for engaging
I'm still unable to read it .
1. My original path was already pointing to the folder that contains both the _delta_log and also the partitioned subfolders containning the parquet data.
2. Should the connection change from ADLS gen2 to something else ?
3. I can't see a format that says Delta.
Community SupportHi nicolasbejar
I want to assure you that there is nothing wrong with the way you originally configured your source. Pointing to the folder that contains _delta_log is exactly what you’re supposed to do for a Delta table, and based on what you described, you were already following the correct Delta Lake conventions. My earlier explanation focused on how Delta tables are normally read from the table root and through the Delta transaction log which is why I highlighted those details.
The key insight, as the Ugk161610 pointed out, is that the limitation isn’t with your setup at all, but with the current capabilities of the Copy Job UI. Even if the path and structure are correct, the Copy Job simply doesn’t recognize Delta Lake tables in ADLS right now, which is why the “Delta” format isn’t appearing for you and why the load continues to fail. Their clarification complements my explanation by making it clear that the issue lies with the tool rather than anything you misconfigured.
So while your approach is right, the Copy Job currently can’t process ADLS-backed Delta tables. Once Delta support is added to the Copy Job, your configuration should work exactly as expected.
I would also like to thank you Ugk161610 for your active participation and for sharing solutions within the community forum.
Regards,
Microsoft Fabric Community Support Team.