Jugi
Microsoft Employee
1 year agoStatus:
Planned
Get data from Apache Kafka topics via private networking
Current prerequisites limit to public Kafka instances which is not feasible for most enterprise customers.
When will this limitation be lifted so that it can be used in private network setups, for example via gateway?
3 Comments
- fbcideas_migusrNew MemberStatus added:New
- UriBarash
Microsoft Employee
Status changed:NewtoNewThere are two ways to get data into RTI from a Kafka topic:
1. Using the Eventstream GetEvents:
- Add Confluent Kafka source to an eventstream - Microsoft Fabric | Microsoft Learn
- Add Apache Kafka source to a Fabric eventstream - Microsoft Fabric | Microsoft Learn
2. Using the open source connectors:
- GitHub - microsoft/kafka-sink-ms-fabric: A kafka sink using Kafka connect to Microsoft Fabric (Eventstream/Kafk endpoint or Eventhouse)
- GitHub - Azure/kafka-sink-azure-kusto: Kafka sink for Kusto (Eventhouse)
- Ingest data from Kafka into Azure Data Explorer - Azure Data Explorer | Microsoft Learn
Both will benefit from the workspace level network isolation coming out soon (for eventstream and eventhouse)
- arindamc
Microsoft Employee
Status changed:NewtoPlanned
Recent ideas
Metadata-Driven Copy Job Control at Table and Column Level
We currently achieve metadata-driven table and column selection in Copy Data activities by using dynamic queries. This allows us to dynamically determine which tables and columns should be processed ...Motasim092 hours agoNew MemberNew4Views0likes0CommentsDynamic ForEach Parallel Batch Count Based on Runtime Capacity
We would like Microsoft Fabric Data Factory to support dynamic configuration of the ForEach activity's parallel batch count at runtime. Currently, the ForEach batchCount is effectively configured as...Motasim092 hours agoNew MemberNew3Views0likes0CommentsMake Workspace-Level Surge Protection Limit Visible to Workspace Users
Please make the applicable workspace-level surge protection limit visible in the workspace settings. Currently, when surge protection is applied by Capacity Admins, workspace users don't get visibil...frithjof_v5 hours agoCommunity ChampionNew27Views2likes0CommentsAllow Custom Recipient Settings for Gateway Expiry Notifications
Now, during the final 90 days before the gateway version end-of-support date, operations continue, but semantic model contacts users can receive warnings in email The warning message is: "The on-prem...YuanMao6 hours agoNew MemberNew8Views1like0Comments