Forum Discussion

EricCarlson's avatar
EricCarlson
Frequent Visitor
9 months ago
Solved

Materialized View Optimal Refresh - Always Doing Full Refresh

I am struggling to get Optimial Refresh working in a Materialized View. It's always doing a Full Refresh.   Source Data I created a table in my lake as delta format, with CDF enablerd, snippets be...
one lake
  • v-venuppu's avatar
    v-venuppu
    9 months ago

    Hi EricCarlson ,

    what you are seeing is expected. Your materialized view only refreshes incrementally for new rows. When existing rows are updated, Fabric cannot detect those changes with the current setup, so it performs a full refresh.To make updates refresh incrementally, the view must include Delta’s change-tracking metadata. If you don’t want those fields exposed, use a two-step approach: a staging view with change tracking, and a clean view for reporting.This ensures incremental refresh works for both new and updated rows.

    Thank you.

v-venuppu's avatar
v-venuppu
Community Support
9 months ago

Hi EricCarlson ,

what you are seeing is expected. Your materialized view only refreshes incrementally for new rows. When existing rows are updated, Fabric cannot detect those changes with the current setup, so it performs a full refresh.To make updates refresh incrementally, the view must include Delta’s change-tracking metadata. If you don’t want those fields exposed, use a two-step approach: a staging view with change tracking, and a clean view for reporting.This ensures incremental refresh works for both new and updated rows.

Thank you.