Change Data Capture

[PSJohnG]

I'm hoping that we will see an increase in connectors that support CDC, we have SQL Server and SAP I believe now, but would love to see this expanded out over Oracle, DB2 (LUW & AS400), MySQL, Postrgre etc.  Working with larger source systems across Wans; it's just not efficent to move millions let alone billions of rows repeatedly, not everything has a reliable timestamp, nor the control to modify the source table structures to add.

[miguel]

help us prioritize this feature. Please post your idea on https://ideas.fabric.microsoft.com/ and share the link to the idea here

[Anonymous]

This is Azure Data Factory feature missing in Fabric Data Factory (Data Pipeline), right? So the question is, when it will be also available in Fabric. 

[miguel]

Hey!

Could you please share more information? What are you referring to Change Data Capture in the context of Microsoft Data Factory Dataflows?

[ScottPowellECU]

I'm sure he's in exactly the same case I am. We have an on-prem SQL server database that will most likely never move to the cloud - is supports our EPIC medical system. I'd love to move the data from it up to Fabric. But there is no way that nightly I can move billions of rows of data.

We'd like CDC so we can do one gigantic "initial load", and after that run nightly incremental processes to only get records that changed. That "should" be doable from a volume standpoint - I don't think copying the entire database is.

Note this is on-prem SQL server, not Azure SQL.

Hope this helps,

Scott

[ScottPowellECU]

And just as an update, it sounds like on-prem SQL server and Oracle mirroring are in private preview. Hopefully we can start kicking the tires on this soon.

Scott