Forum Discussion

Jerome22's avatar
Jerome22
Icon for Resolver I rankResolver I
1 year ago
Solved

updating records using copy job?

Hi,   when Data copy will support updates and not just adding rows? I have a lot of tables which can have updated records, so I want to update my destination not just adding new rows.   thanks.
data engineering
  • Jerome22's avatar
    Jerome22
    1 year ago

    ok... unfortunately it's not supporting deletes.

    and the update appear to update all the rows matching the ID without option to select a hash or timestamp column.

     

    well... I'll still use SQL statements for now. still faster with more control than relying on external tools like the copy job.

     

Jerome22's avatar
Jerome22
Icon for Resolver I rankResolver I
1 year ago

ok... unfortunately it's not supporting deletes.

and the update appear to update all the rows matching the ID without option to select a hash or timestamp column.

 

well... I'll still use SQL statements for now. still faster with more control than relying on external tools like the copy job.

 

smeetsh's avatar
smeetsh
Icon for Continued Contributor rankContinued Contributor
1 year ago

What you could do is incorporate a where statement in the update statement, where you do something like 

"WHERE hash in (select hash from TABLE) AND time_stamp_column > [your timestamp] 

 

The above code is rough and probaly has some syntax errors, but I hope you understand the geste of the logic behind it 🙂

Cheers

Hans