I have a data warehouse table and have a shortcut in Lakehouse to read from it. This setup works perfectly in my development workspace. However, after deploying it to production, I noticed that the shortcut points to my dev warehouse table. So I dropped the Lakehouse shortcut in prod and recreated it to connect to the production data warehouse table. While I can open and view the data from the production lakehouse shortcut table, I encounter an error when trying to read from the notebook using the following code:
config_query = f"SELECT * FROM AF_DE_LH_Bronze.dbo.SCConfig"
config_df = spark.sql(config_query)
This error out with the following.
Py4JJavaError: An error occurred while calling o341.sql. : org.apache.spark.sql.delta.DeltaTableFeatureException: [DELTA_FEATURES_PROTOCOL_METADATA_MISMATCH] Unable to operate on this table because the following table features are enabled in metadata but not listed in protocol: invariants.
Has anyone experienced a similar issue? If so, how did you resolve it? Thanks.
