Forum Discussion
Missing data when replugging model
Hi Victormar ，
Based on your description that you changed the structure in Databricks, the first thing we need to make clear is that you need to make sure that the schema of the new database is the same as the old one. Any differences in table structures, data types or relationships can cause problems when switching databases. Secondly, since both databases are connected to the same cluster, there may be caching issues. Try clearing the cache in Databricks to ensure that the latest data is used. Finally, after switching to the new database, perform a full data refresh. This helps to synchronize the data and resolve any discrepancies.
CLEAR CACHE - Azure Databricks - Databricks SQL | Microsoft LearnBest regards,
Albert HeIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly
Hi Victormar ，
Based on your description that you changed the structure in Databricks, the first thing we need to make clear is that you need to make sure that the schema of the new database is the same as the old one. Any differences in table structures, data types or relationships can cause problems when switching databases. Secondly, since both databases are connected to the same cluster, there may be caching issues. Try clearing the cache in Databricks to ensure that the latest data is used. Finally, after switching to the new database, perform a full data refresh. This helps to synchronize the data and resolve any discrepancies.
CLEAR CACHE - Azure Databricks - Databricks SQL | Microsoft Learn
Best regards,
Albert He
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly