Does KQL Database has to do with Delta table?

[tan_thiamhuat]

It seems to be Delta table is in Lakehouse and separate from the KQL Database, am I correct? 

Isn't the Azure Stream Analytics is correct? Can Azure Stream Analytics can be integrated with KQL (Kusto Query Language) databases?

[v-tsaipranay · Accepted solution]

Hi @tan_thiamhuat ,

We haven’t received an update from you in some time. Could you please let us know if the issue has been resolved?
If you still require support, please let us know, we are happy to assist you.

Thank you.

[v-tsaipranay]

Hi @tan_thiamhuat ,

I wanted to check if you had the opportunity to review the information provided. If you still require support, please let us know, we are happy to assist you.

Also thank you @svenchio  for your helpful response.

Thank you.

[svenchio]

Hi @tan_thiamhuat , I remember these two questions from the test exam for DP-700 ... let's break this into two, what would be the correct answer from the purely "technical" part and what is the "expected" reational needed to get the right anwer.

1️⃣ For the "technical" part, I think the answer offered to you is WRONG! you can read data from a KQL database using Apache Spark in Microsoft Fabric, but not via Spark Structured Streaming;  Apache Spark in Fabric can read from a KQL database using the Kusto Spark connector and the the Kusto Spark connector supports batch reads and writes, not streaming reads.... the correct would have be  Use Microsoft Fabric Eventstream  but is not in the options 

2️⃣ What I explained previouly leads to the "expected" reational ... all other options has NOTHING TO DO WITH Fabric but with Azure (Data Factory, Event Hubs, Stream Analystics), so even the option offered is incorrect, the other options are MORE INCORRECT 😁 (make sense of that!). 

In the second question you share, this is correct, you can process streaming data from IoT devices via Spark Structured Streeaming with Delta Tables!  Hope this clarified the issue and gives you more confident with your exam, best regards. 

[v-tsaipranay]

Hi @tan_thiamhuat ,

Thanks for reaching out to the Microsoft fabric community forum.

You’re correct that Delta tables in Fabric Lakehouse and KQL Database are separate components. Delta tables are designed for ACID-compliant storage and work best with Spark Structured Streaming for real-time ingestion and transformation.

KQL Database is optimized for log and time-series analytics using Kusto Query Language. While you can ingest data from Delta tables into KQL later, they are not the same storage layer.

Regarding Azure Stream Analytics: it’s an Azure service that can output to Azure Data Explorer (ADX), which uses KQL, but it’s not natively integrated with Fabric Lakehouse or KQL Database. In Fabric, the recommended approach for real-time ingestion is Spark Structured Streaming with Delta tables, as shown in the certification question.

For alternatives, Eventstream in Fabric can also handle streaming ingestion and route data to Lakehouse or KQL Database.

Hope this helps. Please feel free to reach out for any further questions.

Thank you.

[tan_thiamhuat]

same for this? is this correct?