Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

mdoss — Wed, 23 Apr 2025 22:08:21 GMT

I have a data warehouse table and have a shortcut in Lakehouse to read from it. This setup works perfectly in my development workspace. However, after deploying it to production, I noticed that the shortcut points to my dev warehouse table. So I dropped the Lakehouse shortcut in prod and recreated it to connect to the production data warehouse table. While I can open and view the data from the production lakehouse shortcut table, I encounter an error when trying to read from the notebook using the following code:

config_query = f"SELECT * FROM AF_DE_LH_Bronze.dbo.SCConfig"

config_df = spark.sql(config_query)

This error out with the following.

Py4JJavaError: An error occurred while calling o341.sql. : org.apache.spark.sql.delta.DeltaTableFeatureException: [DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH] Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: invariants.

Has anyone experienced a similar issue? If so, how did you resolve it? Thanks.

Re: Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

mdoss — Wed, 23 Apr 2025 22:26:10 GMT

I fixed this issue by updating a row in data warehouse table. This doesn't make sense and not sure why this is necessary.

update dbo.ConfigETL

set ConfigId = 9

where ConfigId = 9

topic Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH in Data Engineering

Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH

Re: Reading shortcut table from notebook erroring DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH