Forum Discussion

Regular Visitor

23 days ago

Solved

Fabric Copy Job Timeout

I have a legacy SQL 2008 server (CDC enabled) and a SQL Server 2025, both have fabric connections and use an on prem data gateway. I'm using the Fabric copy job to incrementally transfer data from th...

data engineering

data pipeline

joel_delima
16 days ago
Thanks, I agree with your first statement but its a business requirement that needs to get done in a very short timeframe, and fabric's copy job/cdc feature proved to be the quickest and most efficient option.
I tried using a Fabric pipeline to seed the initial data onto sql2025 then enable cdc to only capture the deltas, however CDC just tries to copy the full dataset and runs into that same timeout error.
I've resolved to using an incremental pipeline instead using a watermark column to migrate new rows.

joel_delima

Regular Visitor

16 days ago

Thanks, I agree with your first statement but its a business requirement that needs to get done in a very short timeframe, and fabric's copy job/cdc feature proved to be the quickest and most efficient option.

I tried using a Fabric pipeline to seed the initial data onto sql2025 then enable cdc to only capture the deltas, however CDC just tries to copy the full dataset and runs into that same timeout error.

I've resolved to using an incremental pipeline instead using a watermark column to migrate new rows.