The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
I have a data mart query that uses several source tables. My sources table is already in delta format. I want if my sources table have an insert/update my datamart will automatically get updated. Or if it still needs some process to insert/update my datamart I want only the incremental changes to be processed. How can I achieve that result in Microsoft fabric/azure synapse?
Solved! Go to Solution.
At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.
alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too
Hi @jovianaditya can I ask what your "data mart" is? Is it a Fabric Lakehouse, Warehouse, etc?
Sorry, let me clarify. What I mean "data mart" is a table that resides in lakehouse or warehouse. Can data factory in microsoft fabric use the CDC concept like in Azure Data Factory / Data flow in azure synapse?
At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.
alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too
User | Count |
---|---|
15 | |
10 | |
7 | |
4 | |
3 |
User | Count |
---|---|
46 | |
23 | |
18 | |
17 | |
12 |