Forum Discussion
Missing data when replugging model
- Anonymous1 year ago
Hi Victormar ,
Based on your description that you changed the structure in Databricks, the first thing we need to make clear is that you need to make sure that the schema of the new database is the same as the old one. Any differences in table structures, data types or relationships can cause problems when switching databases. Secondly, since both databases are connected to the same cluster, there may be caching issues. Try clearing the cache in Databricks to ensure that the latest data is used. Finally, after switching to the new database, perform a full data refresh. This helps to synchronize the data and resolve any discrepancies.
CLEAR CACHE - Azure Databricks - Databricks SQL | Microsoft LearnBest regards,
Albert HeIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly
Hello!
Thanks for your reply, really good to know.
It turns out in the end the problem was that I had two functions to change between environments, and I only updated one, I totally missed the other one (was hidden between the tables ;P)
But your explanation Anonymous it's super good to know, thanks 🙂