Forum Discussion
debiagui
Resolver I
Resolver IDebuging MySql partitions in a dataflow with an incremental refresh
So that's my case. We have a on-premises MySql connected to a dataflow with a Data Gateway and using incremental refresh. The incremental refresh is set to archive last 10 years and refresh the las...
lbendlin
Super User
Super Usera Python script that update or create the records in the table for the last week.
That's not what incremental refresh is about. To emulate differential refresh you need to widen your hot update window (say, last 4 weeks instead of last week) and you need to plan for periodic full refreshes, also of older partitions.
debiaguiResolver I
Resolver Ia Python script that update or create the records in the table for the last week.
This is only trying to explain the general process, but the problem is in the incremental refresh, the script in python is just the way to feed the database