Forum Discussion
CDC when making a datamart
I have a data mart query that uses several source tables. My sources table is already in delta format. I want if my sources table have an insert/update my datamart will automatically get updated. Or if it still needs some process to insert/update my datamart I want only the incremental changes to be processed. How can I achieve that result in Microsoft fabric/azure synapse?
At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.
alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too
3 Replies
- AndyDDCMost Valuable Professional
Hi jovianaditya can I ask what your "data mart" is? Is it a Fabric Lakehouse, Warehouse, etc?
- jovianadityaFrequent Visitor
Sorry, let me clarify. What I mean "data mart" is a table that resides in lakehouse or warehouse. Can data factory in microsoft fabric use the CDC concept like in Azure Data Factory / Data flow in azure synapse?
- AndyDDCMost Valuable Professional
At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.
alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too