Forum Discussion
lg01
Advocate III
Advocate IIIDatamart Incremental refresh logic
I am trying to set up incremental refresh in some tables of my datamart. The documentation says that the incremental refresh is basically a "partition" of the window we want to refresh and this windo...
does that mean it will always maintain 5 years of data to the date and truncate the most recent year and reload it including all the new records?Mostly correct. In reality it will do full years (partitions are defined by regular calendar boundaries). So for a while you may end up with six partitions instead of five.
Stay away from the "Detect data changes" setting. It will double your storage requirements. You should know when older partitions need to be refreshed, and you should decide when to do that.
lg01Advocate III
Advocate IIIThanks for your reply! That is great to know. How can I see these partitions?
lbendlin
Super User
Super UserThat would be nice, wouldn't it? But datamarts are based on dataflows which are based on csv/parquet files. There is no known (to me) way to access these partitions directly, neither for dataflows nor for datamarts.