Forum Discussion
Delta shallow clone not visible via SQL endpoint
- 23 days ago
Hi pradipsodha​ ,
Thank you for reaching out to fabric community.
A shallow clone does not copy the underlying Parquet files. Instead, its Delta log contains references to the source table's files. In this case, those references are stored as absolute abfss:// paths.
The Spark engine can read these paths successfully, which is why the shallow clone works when queried through Spark. However, when the SQL analytics endpoint performs its metadata synchronization, it fails to process the absolute file paths and returns:
DeltaTableUserException: Absolute file path is not supported
If the table needs to be queried through the SQL analytics endpoint, avoid SHALLOW CLONE and create an independent Delta table instead, for example:
CREATE TABLE dbo.sclone AS
SELECT * FROM dbo.original;
This creates new underlying data files for the table, allowing the SQL analytics endpoint to synchronize the table normally.
https://learn.microsoft.com/en-us/fabric/data-engineering/delta-lake-clone?tabs=sparksql
https://learn.microsoft.com/en-us/fabric/data-engineering/sql-analytics-endpoint-metadata-sync
Thanks!!
Hi pradipsodha​ ,
Thank you for reaching out to fabric community.
A shallow clone does not copy the underlying Parquet files. Instead, its Delta log contains references to the source table's files. In this case, those references are stored as absolute abfss:// paths.
The Spark engine can read these paths successfully, which is why the shallow clone works when queried through Spark. However, when the SQL analytics endpoint performs its metadata synchronization, it fails to process the absolute file paths and returns:
DeltaTableUserException: Absolute file path is not supported
If the table needs to be queried through the SQL analytics endpoint, avoid SHALLOW CLONE and create an independent Delta table instead, for example:
CREATE TABLE dbo.sclone AS
SELECT * FROM dbo.original;
This creates new underlying data files for the table, allowing the SQL analytics endpoint to synchronize the table normally.
https://learn.microsoft.com/en-us/fabric/data-engineering/delta-lake-clone?tabs=sparksql
https://learn.microsoft.com/en-us/fabric/data-engineering/sql-analytics-endpoint-metadata-sync
Thanks!!