Forum Discussion
Resolver Iupdating records using copy job?
ok... unfortunately it's not supporting deletes.
and the update appear to update all the rows matching the ID without option to select a hash or timestamp column.
well... I'll still use SQL statements for now. still faster with more control than relying on external tools like the copy job.
Continued ContributorWe often do a clear out of tables or certain rows in tables, but we have a few datasets that are so large that is slows things down.
This can de done with just pipeline activities (copy and script activity), notebooks are not always needed. I would only use a notebook when i need to do something with a lakehouse.
Super Usersmeetsh We always have Notebooks. No issues. Instead of Data Factory, Use Notebooks wherever we can. Databricks has implemented Delta Lake and then Microsoft follows Databricks. ( Delta Lake is based on Python and Scala ).
- smeetsh
I could be wrong here, but I don't think a notebook can write to a warehouse, which for us at least would be the issue and it may be as well for the topic starter