Forum Discussion
Upsert operation Eventstream into a delta table
how do i do an upsert operation in the eventstreams to a delta table? i dont see in the transformation event has the option to do an upsert using Key.
Does the only way to do upsert is using azure event hub with Spark job?
For now I would run a notebook (Spark.)
Or - and mind you, I haven't tested this on Onelake, only SQL - use a UDF in Kusto that upserts to a OneLake shortcut/external table (https://learn.microsoft.com/en-us/fabric/real-time-intelligence/onelake-shortcuts?tabs=onelake-shortcut)
for event stream and lakehouse integration today, append is the already operator supported. there is one backlog item tracking the "delete" and "upsert" operator support for lakehouse
4 Replies
- JohanLudvig
Advocate I
Upsert isn't supported. And not sure if that support will come in the future - but maybe if Eventstreams get to parity with Stream Analytics it will be possible.
joezhang-esMicrosoft Employee
for event stream and lakehouse integration today, append is the already operator supported. there is one backlog item tracking the "delete" and "upsert" operator support for lakehouse
- JohanLudvig
For now I would run a notebook (Spark.)
Or - and mind you, I haven't tested this on Onelake, only SQL - use a UDF in Kusto that upserts to a OneLake shortcut/external table (https://learn.microsoft.com/en-us/fabric/real-time-intelligence/onelake-shortcuts?tabs=onelake-shortcut)