Forum Discussion
BW_RFA
Helper I
2 years agoUpdate delta table only with changed fields
Hi, I have a delta table that needs updating with new data every 10 mins. The data that comes in has many fields but maybe only 1 of them is actually different from the target table. As I nee...
BW_RFA
Helper I
2 years agoI have realised that "EXCEPT" is not supported in Delta yet. How can I solve this problem?
I want to only update the columns that have changed, not all of the columns.
Anonymous
2 years agoNot applicable
Hi BW_RFA ,
I can suggest these document to refer as it might help you -
Upsert into a Delta Lake table using merge | Databricks on AWS
Why Upsert in Databricks using Pyspark is a bad idea, or is it ? | by Debayan Kar | Medium