Forum Discussion

souvik666's avatar
souvik666
New Member
4 months ago
Solved

Eventstream Doubt

Suppose I use an EvenStream and I have 2 data sources with 2 different types of schemas, and I want to dump the data to the Evenhouse DB in two different tables. How do I segregate the 2 types of dat...
data engineering
  • arabalca's avatar
    arabalca
    4 months ago

    Hi souvik666 ,

     

    Your diagram already shows the correct approach! The pattern you've implemented is exactly what Microsoft recommends for this scenario. What is the questions?

     

    What you've done right:

    • Two separate sources (YellowTaxi and Kafka_Src) feeding into a single Eventstream (EV_prod)
    • A Filter node per branch to separate the data by origin
    • Two independent Eventhouse destinations (EH_Kafka and EH_Taxi) pointing to different tables in the same KQL database
    • This is the standard way to route data from multiple sources with different schemas into separate Eventhouse tables — no code required, just the visual editor.

    Official documentation:

    Overview & multiple destinations: https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/overview

     

    If my comments helped solve your question, it would be great if you could like the two comments and mark it as the accepted solution. It helps others with the same issue and also motivates me to keep contributing.

     

    Thanks a lot, I really appreciate it.

rizalard0684's avatar
rizalard0684
Resolver III
3 months ago

hey souvik666 the answer by arabalca  is correct and I'm aligned with him.

 

I just want to clarify some terminologies (item vs routing vs stream) because it's quite confusing:

  1. Fabric EventStream item -> this is the Fabric item "EventStream" we create at Fabric workspace lavel
  2. Inside Fabric EventStream item, this is (what I personally called) an EventStream routing -> this is your EV_prod
  3. Inside Fabric EventStream routing, there is a stream -> this is your EV_prod-stream


Now comes my opinions:

  1. Eventstream item has a single unified schema by default. All events flowing through it are merged into one routing / stream and makes it look like you can’t separate different source streams cleanly.
  2. However, Fabric supports content-based routing inside one Eventstream item using operations (e.g. filter, manage fields and multiple Eventhouse destinations). https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/route-events-based-on-content

In short, you can’t split into multiple eventsream routings/streams, however you can split into multiple Eventhouse tables but must do it via filters inside one Eventstream item. Hope this makes sense.


Appreciate if you can 'Kudos' and/or 'Accept as Solution' if this answered your query.