Forum Discussion
Event Hubs Spark connector should support Managed Identity without custom Java callbacks
Hi moboyal1 ,
Thanks for reaching out to Community Forum.This matches the current behavior in Microsoft Fabric and Event Hubs. To use Azure AD with the Spark connector, a custom 'AadAuthenticationCallback' Java/Scala JAR is required , however in Fabric’s managed Spark environment, such dependencies are not natively supported across executors, which can lead to errors like ClassNotFoundException.
Additionally, the Microsoft Fabric Eventstream Event Hub source documentation describes connectivity using SAS based connection strings, and no alternative authentication methods such as Managed Identity or Entra ID are described.
Based on this, scenarios requiring Azure AD - only authentication may face limitations when using these connectors in Fabric.References -
https://learn.microsoft.com/azure/event-hubs/event-hubs-kafka-spark-tutorial
https://learn.microsoft.com/fabric/real-time-intelligence/event-streams/add-source-azure-event-hubs
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-manage-eventstream-sources
Hi moboyal1 ,
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.
Hi moboyal1 ,
I hope the above details help you fix the issue. If you still have any questions or need more help, feel free to reach out. We’re always here to support you