Forum Discussion

jovianaditya's avatar
jovianaditya
Frequent Visitor
2 years ago
Solved

CDC when making a datamart

I have a data mart query that uses several source tables. My sources table is already in delta format. I want if my sources table have an insert/update my datamart will automatically get updated. Or if it still needs some process to insert/update my datamart I want only the incremental changes to be processed. How can I achieve that result in Microsoft fabric/azure synapse?

  • AndyDDC's avatar
    AndyDDC
    2 years ago

    At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.

     

    alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too

3 Replies

  • AndyDDC's avatar
    AndyDDC
    Most Valuable Professional

    Hi jovianaditya can I ask what your "data mart" is?  Is it a Fabric Lakehouse, Warehouse, etc?

    • jovianaditya's avatar
      jovianaditya
      Frequent Visitor

      Sorry, let me clarify. What I mean "data mart" is a table that resides in lakehouse or warehouse. Can data factory in microsoft fabric use the CDC concept like in Azure Data Factory / Data flow in azure synapse?

      • AndyDDC's avatar
        AndyDDC
        Most Valuable Professional

        At the moment no, there's no out of the box CDC functionality in fabric data factory/Dataflows. You'll need you're own solution using available change datetime from source data.

         

        alternativey there is Delta Change Data Feed available if you use notebooks. This works as a cdc mechanism too