Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Fabric Data Days Monthly is back. Join us on March 26th for two expert-led sessions on 1) Getting Started with Fabric IQ and 2) Mapping & Spacial Analytics in Fabric. Register now

All CDC Changes to be captured in Copy Job's Incremental Copy

Would love to have all changes copied over instead of just net changes. This is useful too if a data deletions can be captured, at least into bronze layer, then users can subsequently manage change records going into silver layer. It makes changes more transparent to the data engineer and opens up options with data management, I think.  

Status: Needs Votes
Comments
yexu
Microsoft Employee
Status changed to: Needs Votes
 
kjetil_hamre
Frequent Visitor

Name of the feature is "Append Mode for CDC", rather than "Merge" which is already implemented and gives you net changes. Useful only for mirroring.

Needs votes - even though this is basic functionality!

PeterDaniels
Advocate II
I would love to see this for simplified SCD prep. Append mode for CDC. I'd like to see some sort of CRUD indicator, too. If we really want to get fancy, how about automatic generation of effective date columns? I can dream, right? 😉 even - which subset of columns we care about changing?
PeterDaniels
Advocate II
Required columns auto-added: __cdc_operation __cdc_commit_ts __cdc_sequence