Forum Discussion
Datamart Incremental refresh logic
does that mean it will always maintain 5 years of data to the date and truncate the most recent year and reload it including all the new records?Mostly correct. In reality it will do full years (partitions are defined by regular calendar boundaries). So for a while you may end up with six partitions instead of five.
Stay away from the "Detect data changes" setting. It will double your storage requirements. You should know when older partitions need to be refreshed, and you should decide when to do that.
does that mean it will always maintain 5 years of data to the date and truncate the most recent year and reload it including all the new records?Mostly correct. In reality it will do full years (partitions are defined by regular calendar boundaries). So for a while you may end up with six partitions instead of five.
Stay away from the "Detect data changes" setting. It will double your storage requirements. You should know when older partitions need to be refreshed, and you should decide when to do that.
Thanks for your reply! That is great to know. How can I see these partitions?
That would be nice, wouldn't it? But datamarts are based on dataflows which are based on csv/parquet files. There is no known (to me) way to access these partitions directly, neither for dataflows nor for datamarts.
