Forum Discussion
Handling schema changes and multiple schemas in Eventstream
thanks for reaching out. that is the multiple schema issue we are handling with now and we also got the feedbacks from other customer feedbacks for this requirement. for our no code editor, we are heavily replying on the data sampling and also can only use one inferred column from sampling data for authoring the operator which will cause some potential issues.
we are proactively working on this new capability and after we have the multiple schema solution and event catalog integration story, we can resolve this scenarios perfectly that means each filter and managed can depend on the different schemas
hopefully we can have this released out in the following 3 ~ 6 months.
Hi galaeci ,
I would like to ask what kind of changes you are referring to in the architecture? Is it an extension of the architecture?
I read the official documentation and found that most of the currently supported data sources only support obtaining row-level data in the data source, but not changes in the schema:
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/overview?tabs=enhancedcapabilities#bring-events-into-fabric
Additionally, there should be a step to set up the schema when you stream real-time events from a custom application to a Microsoft Fabric KQL database:
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/stream-real-time-events-from-custom-app-to-kusto#add-a-kql-database-destination-to-the-eventstream
After my own testing, it seems that after setting the architecture here, the architecture model is fixed and will not be changed.
Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
is there any update in this in fabric?
i see schema getting changed automatically as per message but due to dofferent schemas sometime new messge with different schema trying ti incorporate into existing schema and values are missing