Forum Discussion

joel_delima's avatar
joel_delima
Regular Visitor
23 days ago
Solved

Fabric Copy Job Timeout

I have a legacy SQL 2008 server (CDC enabled) and a SQL Server 2025, both have fabric connections and use an on prem data gateway. I'm using the Fabric copy job to incrementally transfer data from th...
data engineering
data pipeline
  • joel_delima's avatar
    joel_delima
    16 days ago

    Thanks, I agree with your first statement but its a business requirement that needs to get done in a very short timeframe, and fabric's copy job/cdc feature proved to be the quickest and most efficient option.

    I tried using a Fabric pipeline to seed the initial data onto sql2025 then enable cdc to only capture the deltas, however CDC just tries to copy the full dataset and runs into that same timeout error.

    I've resolved to using an incremental pipeline instead using a watermark column to migrate new rows.

v-csrikanth's avatar
v-csrikanth
Icon for Community Support rankCommunity Support
17 days ago

Hi joel_delima​ 

We would like to inquire whether have you got the chance to check the solutions provided by other users in community to resolve the issue. We hope the information provided helps to clear the query. Should you have any further queries, kindly feel free to contact the Microsoft Fabric community.