Upsert operation in KQL db to update existing records while loading data using Eventstream

[supriyapandey19]

Hi,

Can we do Upsert operation in KQL db to update existing records while loading data using Eventstream.

I have the scenario of updating the existing records in KQL db while loading real time data using Evenstream instead of loading duplicate data every time eventsream is run.

Any article, workarounds or refernece would be appreciated.

Thanks.

[datacoffee · Accepted solution]

Great news here (I know this is an old post) but UPDATE and DELETE has been introduced to the Kusto engine.

I've done some bloggin about the topic - please feel free to read it here: Updates and Deletes in the KQL engine

[BrianSherwin]

KQL databases are append only. Per your request for an article, check out this post:
How to handle data updates in Azure Data Explorer - Microsoft Community Hub

[v-tangjie-msft]

Hi @supriyapandey19 ,

In the realm of KQL (Kusto Query Language) databases, the concept of an "upsert" operation, as traditionally understood in databases like SQL, does not directly apply. KQL databases are designed to append data efficiently and are optimized for fast data ingestion and querying. This design choice means that KQL databases do not natively support updating or deleting individual records once they have been ingested.

You can post your idea to Ideas. https://ideas.powerbi.com/ideas/

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.