Get data from Apache Kafka topics via private networking

[Jugi]

Current prerequisites limit to public Kafka instances which is not feasible for most enterprise customers.

When will this limitation be lifted so that it can be used in private network setups, for example via gateway?

https://learn.microsoft.com/en-gb/fabric/real-time-intelligence/event-streams/add-source-apache-kafk...

[UriBarash]

There are two ways to get data into RTI from a Kafka topic:

1. Using the Eventstream GetEvents:

• Add Confluent Kafka source to an eventstream - Microsoft Fabric | Microsoft Learn
• Add Apache Kafka source to a Fabric eventstream - Microsoft Fabric | Microsoft Learn

2. Using the open source connectors:

• GitHub - microsoft/kafka-sink-ms-fabric: A kafka sink using Kafka connect to Microsoft Fabric (Eventstream/Kafk endpoint or Eventhouse)
• GitHub - Azure/kafka-sink-azure-kusto: Kafka sink for Kusto (Eventhouse)
• Ingest data from Kafka into Azure Data Explorer - Azure Data Explorer | Microsoft Learn

Both will benefit from the workspace level network isolation coming out soon (for eventstream and eventhouse)