Forum Discussion
Incremental Refresh completes successfully but latest source data is not reflected in reports
Your partition column is the problem. You're partitioning on UPDATE_DATETIME but filtering rows that belong to old CALL_DATE values.
Fix: partition on the stable business date (CALL_DATE), not the mutable UPDATE_DATETIME. Use UPDATE_DATETIME only for Detect Data Changes.
yes, it reloads all rows in the window, but "the window" is defined by UPDATE_DATETIME, so rows whose UPDATE_DATETIME falls outside the last 7 days never reload even though their CALL_DATE looks recent.
Your partition column is the problem. You're partitioning on UPDATE_DATETIME but filtering rows that belong to old CALL_DATE values.
Fix: partition on the stable business date (CALL_DATE), not the mutable UPDATE_DATETIME. Use UPDATE_DATETIME only for Detect Data Changes.
yes, it reloads all rows in the window, but "the window" is defined by UPDATE_DATETIME, so rows whose UPDATE_DATETIME falls outside the last 7 days never reload even though their CALL_DATE looks recent.