Forum Discussion

EricCarlson's avatar
EricCarlson
Frequent Visitor
9 months ago
Solved

Materialized View Optimal Refresh - Always Doing Full Refresh

I am struggling to get Optimial Refresh working in a Materialized View. It's always doing a Full Refresh.   Source Data I created a table in my lake as delta format, with CDF enablerd, snippets be...
one lake
  • v-venuppu's avatar
    v-venuppu
    9 months ago

    Hi EricCarlson ,

    what you are seeing is expected. Your materialized view only refreshes incrementally for new rows. When existing rows are updated, Fabric cannot detect those changes with the current setup, so it performs a full refresh.To make updates refresh incrementally, the view must include Delta’s change-tracking metadata. If you don’t want those fields exposed, use a two-step approach: a staging view with change tracking, and a clean view for reporting.This ensures incremental refresh works for both new and updated rows.

    Thank you.

EricCarlson's avatar
EricCarlson
Frequent Visitor
8 months ago

I am curious about where the documentation is to support these requirements listed above, specifically these additional columns you mention that are required on the source table and in the MLV.    

MattSB's avatar
MattSB
Helper I
8 months ago

I'm pretty sure the guy is Kudos farming with AI responses. In this instance I think the response has combined references from Databricks with Fabric.