Forum Discussion

pradipsodha's avatar
pradipsodha
New Member
24 days ago
Solved

Delta shallow clone not visible via SQL endpoint

Context In fabric lakehouse there are two entry points 1. spark cluster 2. SQL endpoint and lakehouse provides delta shallow clone feature. Problem When i create a shallow clone and then i switch ...
  • v-sathmakuri's avatar
    23 days ago

    Hi pradipsodha​ ,

    Thank you for reaching out to fabric community.

    A shallow clone does not copy the underlying Parquet files. Instead, its Delta log contains references to the source table's files. In this case, those references are stored as absolute abfss:// paths.

    The Spark engine can read these paths successfully, which is why the shallow clone works when queried through Spark. However, when the SQL analytics endpoint performs its metadata synchronization, it fails to process the absolute file paths and returns:

    DeltaTableUserException: Absolute file path is not supported

    If the table needs to be queried through the SQL analytics endpoint, avoid SHALLOW CLONE and create an independent Delta table instead, for example:

    CREATE TABLE dbo.sclone AS

    SELECT * FROM dbo.original;

    This creates new underlying data files for the table, allowing the SQL analytics endpoint to synchronize the table normally.

    https://learn.microsoft.com/en-us/fabric/data-engineering/delta-lake-clone?tabs=sparksql 

    https://learn.microsoft.com/en-us/fabric/data-engineering/sql-analytics-endpoint-metadata-sync 

    Thanks!!