Forum Discussion

mdoss's avatar
mdoss
Frequent Visitor
1 year ago
Solved

Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

I have a data warehouse table and have a shortcut in Lakehouse to read from it. This setup works perfectly in my development workspace. However, after deploying it to production, I noticed that the shortcut points to my dev warehouse table. So I dropped the Lakehouse shortcut in prod and recreated it to connect to the production data warehouse table. While I can open and view the data from the production lakehouse shortcut table, I encounter an error when trying to read from the notebook using the following code:

 

config_query = f"SELECT * FROM AF_DE_LH_Bronze.dbo.SCConfig"

config_df = spark.sql(config_query)

 

This error out with the following.

Py4JJavaError: An error occurred while calling o341.sql. : org.apache.spark.sql.delta.DeltaTableFeatureException: [DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH] Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: invariants.

 

Has anyone experienced a similar issue? If so, how did you resolve it? Thanks.

 

  • I fixed this issue by updating a row in data warehouse table. This doesn't make sense and not sure why this is necessary. 

     

    update dbo.ConfigETL

    set ConfigId = 9
    where ConfigId = 9

1 Reply

  • mdoss's avatar
    mdoss
    Frequent Visitor

    I fixed this issue by updating a row in data warehouse table. This doesn't make sense and not sure why this is necessary. 

     

    update dbo.ConfigETL

    set ConfigId = 9
    where ConfigId = 9