Forum Discussion

manoj_0911's avatar
manoj_0911
Kudo Commander
2 months ago
Solved

Incremental Refresh completes successfully but latest source data is not reflected in reports

I am observing an unexpected behavior with Incremental Refresh and would like to understand if this is expected. My current configuration: Incremental Refresh partition column: UPDATE_DATETIME ...
  • Kedar_Pande's avatar
    2 months ago

    manoj_0911 

     

    Your partition column is the problem. You're partitioning on UPDATE_DATETIME but filtering rows that belong to old CALL_DATE values.

    Fix: partition on the stable business date (CALL_DATE), not the mutable UPDATE_DATETIME. Use UPDATE_DATETIME only for Detect Data Changes.


    yes, it reloads all rows in the window, but "the window" is defined by UPDATE_DATETIME, so rows whose UPDATE_DATETIME falls outside the last 7 days never reload even though their CALL_DATE looks recent.