Don't miss your chance to take the Fabric Data Engineer (DP-700) exam on us!
Learn moreWe've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now
how do i do an upsert operation in the eventstreams to a delta table? i dont see in the transformation event has the option to do an upsert using Key.
Does the only way to do upsert is using azure event hub with Spark job?
Solved! Go to Solution.
For now I would run a notebook (Spark.)
Or - and mind you, I haven't tested this on Onelake, only SQL - use a UDF in Kusto that upserts to a OneLake shortcut/external table (https://learn.microsoft.com/en-us/fabric/real-time-intelligence/onelake-shortcuts?tabs=onelake-short...)
for event stream and lakehouse integration today, append is the already operator supported. there is one backlog item tracking the "delete" and "upsert" operator support for lakehouse
for event stream and lakehouse integration today, append is the already operator supported. there is one backlog item tracking the "delete" and "upsert" operator support for lakehouse
thank you. so how do i do an upsert to a delta table then?
For now I would run a notebook (Spark.)
Or - and mind you, I haven't tested this on Onelake, only SQL - use a UDF in Kusto that upserts to a OneLake shortcut/external table (https://learn.microsoft.com/en-us/fabric/real-time-intelligence/onelake-shortcuts?tabs=onelake-short...)
Upsert isn't supported. And not sure if that support will come in the future - but maybe if Eventstreams get to parity with Stream Analytics it will be possible.
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.