Forum Discussion

gopala000's avatar
gopala000
Frequent Visitor
1 year ago
Solved

Reading an existing DeltaTable throws DELTA_MISSING_DELTA_TABLE error

In the following code to move some tables from bronze to silver, I create the delta table in silver if it does not exists and merge the changes if a table exists already.  delta.DeltaTable.forPath...
Pipeline
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi gopala000 ,

     

    For the DELTA_MISSING_DELTA_TABLE error problem, this error typically indicates that the specified path does not contain a valid Delta table. Make sure that the path you provide to delta.DeltaTable.forPath() is correct and points to a valid Delta table.

    dest = delta.DeltaTable.forPath(spark, f"abfss://<GUID REMOVED>@onelake.dfs.fabric.microsoft.com/<GUID REMOVED>/Tables/{x}/")

     

    Best Regards,
    Adamk Kong

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi gopala000 ,

 

For the DELTA_MISSING_DELTA_TABLE error problem, this error typically indicates that the specified path does not contain a valid Delta table. Make sure that the path you provide to delta.DeltaTable.forPath() is correct and points to a valid Delta table.

dest = delta.DeltaTable.forPath(spark, f"abfss://<GUID REMOVED>@onelake.dfs.fabric.microsoft.com/<GUID REMOVED>/Tables/{x}/")

 

Best Regards,
Adamk Kong

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

gopala000's avatar
gopala000
Frequent Visitor
1 year ago

Thanks for your response. I had to add x.lower() in the line to get the DeltaTable using forPath()

to get past the error. Fixed a code bug in the last line to 

dest.alias('target').merge(df_filtered.alias('changes'), "target.Id = changes.Id").whenMatchedUpdateAll().whenNotMatchedInsertAll().whenNotMatchedBySourceDelete().execute() to get it working! Thank you.

 Anonymous