Forum Discussion
Solved
Daily Incremental Refresh
I am working with large snowflake data and hence would like to use incremental refresh. The data I'm working with has several columns with the key ones being create_timestamp, update_timestamp and un...
considered using an incremental refresh policy with "Set incremental period to 1 day prior to refresh" and archival period of 3 years based on update_ts. Would this accomplish steps 1 and 2 described above?yes.
If you use update_ts instead of create_ts you will end up with duplicates of your rows across multiple partitions, and you will have to include occasional partition refreshes in your process (or consider using the "track changes" feature - at an enormous storage cost - to handle changes for you).
lbendlin can you explain how the track changes feature works on the backend? Couldn't find any documentation.