Forum Discussion
arkiboys2
1 year agoHelper IV
data replication from source upon change
Hello,
I have created data factory pipelines in fabric which ingests data from sql server and lands into fabric warehouse once a day.
How is it possible to ingest the sql server table data only when they change at source?
thank you
It is but only for Azure SQL Database, not SQL Server. Others supported is CosmosDB, Databricks, Snowflake,
5 Replies
- AndyDDCMost Valuable Professional
Hi arkiboys2 there is nothing yet that can detect source data changes (e.g. CDC) so you'll need to implement some form of scheduled polling with incremental loading.
We're still waiting to see if any CDC functionality will be added, and also when we can mirror SQL Server data into Fabric itself.