Choosing between Eventstreams vs Apache Structured Streaming for Unstructured & Structured Data

[anatnatnat]

Hi everyone, 

I recently took the DP-700 exam (and am preparing for a retake). I came across a scenario regarding real time intelligence that has left me a bit confused about the best practices in Fabric. I would appreciate some guidance on the correct architectural decision.

The Scenario: The requirements involved selecting the correct stream processing technology for three specific data types. The options provided were roughly: Eventstream, Apache Structured Streaming, Data Stream, etc.

The three data conditions were:

1. Unstructured Data: Handling complex raw data (likely video/audio/binary).

2. Semi-structured Data: Standard JSON logs/IoT telemetry.

3. Structured Data: A small set of reference data (the scenario mentioned something specific like "19 lines" or a small static table to join with the stream).

My Confusion: Initially, I assumed Fabric Eventstreams was the unified answer for all ingestion types in Fabric. However, I am now doubting if Eventstreams can efficiently handle complex Unstructured Data or complex joins with static Structured Data.
Could you please share any official documentation, blog posts, or decision guides that clearly compare these two? I want to understand the specific use cases for each so I don't mix them up again.

Thank u so much

[v-nmadadi-msft]

Hi @anatnatnat 

I wanted to check if you had the opportunity to review the valuable information provided by @suparnababu8 . Please feel free to contact us if you have any further questions.

Thank you.

[suparnababu8 · Accepted solution]

Hi @anatnatnat 

Fabric eventstreams are best suited for ingesting and processing the semi-structured event data like  JSON logs/IoT telemetry data. 

While coming to Apache Structured Streaming, it si the very good choice to process complex un-structureed data  like video/audio/binary and you can use complex joins as well. 

Please go through belwo links, iot might helps you

Building a Real-Time Weather Dashboard in Microsof... - Microsoft Fabric Community

Microsoft Fabric Eventstreams Overview - Microsoft Fabric | Microsoft Learn

Streaming data into lakehouse - Microsoft Fabric | Microsoft Learn

Real-Time Intelligence in Microsoft Fabric documentation - Microsoft Fabric | Microsoft Learn

Pleaase let em know if it helps you!!

Thank you!!

Did I answer your question? Mark my post as a solution!

Proud to be a Super User!

[anatnatnat]

Thank u so much for the reply, it means a lot to me! Surely I will check the material given 🙂