Forum Discussion

PSJohnG's avatar
PSJohnG
Regular Visitor
3 years ago

Change Data Capture

I'm hoping that we will see an increase in connectors that support CDC, we have SQL Server and SAP I believe now, but would love to see this expanded out over Oracle, DB2 (LUW & AS400), MySQL, Postrg...
Dataflows
miguel's avatar
miguel
Community Admin
3 years ago

Hey!

Could you please share more information? What are you referring to Change Data Capture in the context of Microsoft Data Factory Dataflows?

  • ScottPowellECU's avatar
    ScottPowellECU
    Advocate II
    3 years ago

    I'm sure he's in exactly the same case I am. We have an on-prem SQL server database that will most likely never move to the cloud - is supports our EPIC medical system. I'd love to move the data from it up to Fabric. But there is no way that nightly I can move billions of rows of data.

     

    We'd like CDC so we can do one gigantic "initial load", and after that run nightly incremental processes to only get records that changed. That "should" be doable from a volume standpoint - I don't think copying the entire database is.

     

    Note this is on-prem SQL server, not Azure SQL.

     

    Hope this helps,

    Scott

    • ScottPowellECU's avatar
      ScottPowellECU
      Advocate II
      1 year ago

      And just as an update, it sounds like on-prem SQL server and Oracle mirroring are in private preview. Hopefully we can start kicking the tires on this soon.

       

      Scott