Forum Discussion

jovianaditya's avatar
jovianaditya
Frequent Visitor
2 years ago
Solved

CDC when making a datamart

I have a data mart query that uses several source tables. My sources table is already in delta format. I want if my sources table have an insert/update my datamart will automatically get updated. Or ...
data engineering
Data Integration
  • AndyDDC's avatar
    AndyDDC
    2 years ago

    At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.

     

    alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too

AndyDDC's avatar
AndyDDC
Icon for Most Valuable Professional rankMost Valuable Professional
2 years ago

Hi jovianaditya can I ask what your "data mart" is?  Is it a Fabric Lakehouse, Warehouse, etc?

  • jovianaditya's avatar
    jovianaditya
    Frequent Visitor
    2 years ago

    Sorry, let me clarify. What I mean "data mart" is a table that resides in lakehouse or warehouse. Can data factory in microsoft fabric use the CDC concept like in Azure Data Factory / Data flow in azure synapse?

    • AndyDDC's avatar
      AndyDDC
      Icon for Most Valuable Professional rankMost Valuable Professional
      2 years ago

      At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.

       

      alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too