Event Hubs Spark connector should support Managed Identity without custom Java callbacks

Hi moboyal1 ,
Thanks for reaching out to Community Forum.

This matches the current behavior in Microsoft Fabric and Event Hubs. To use Azure AD with the Spark connector, a custom 'AadAuthenticationCallback' Java/Scala JAR is required , however in Fabric’s managed Spark environment, such dependencies are not natively supported across executors, which can lead to errors like ClassNotFoundException.

Additionally, the Microsoft Fabric Eventstream Event Hub source documentation describes connectivity using SAS based connection strings, and no alternative authentication methods such as Managed Identity or Entra ID are described.

Based on this, scenarios requiring Azure AD - only authentication may face limitations when using these connectors in Fabric.

References - 
https://learn.microsoft.com/azure/event-hubs/event-hubs-kafka-spark-tutorial
https://learn.microsoft.com/fabric/real-time-intelligence/event-streams/add-source-azure-event-hubs
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-manage-eventstream-sources