EventStream Azure Service Bus as Source | Connect Exception with on-prem data gateway connection

[to-know-better]

We're considering using Eventstream to ingest data from an ASB queue seamlessly into Microsoft Fabric.

Given that our current Fabric is configured to be public with conditional access, reaching the ASB with public access disabled can only be achieved with the use of on-prem data gateway. We are able to exchange data with Web Activity V2 connection but the downside of that is a face some limitation related to the REST client which does not support batching in reception side. Hence, EventStream seem to be a better approach. 

However, I am running into a org.apache.kafka.connect.errors.ConnectException issue with the connection with Shared Access Key.

The connection of type Azure Service Bus is created within the Manage Connections and Gateways screen due to the limitation of the create connection screen in EventStream which is missing the option to select the data gateway.

The local authentication is enabled and the shared access key name and key are correct and verified. Can you please advise? 

Besides this error, a general question is there a plan to have the Service Principal authentication type added to the Azure Service Bus connection type?

{
    "ErrorCode": {
        "value": "Task: '19d01fad-a58e-4bfa-8a4b-3c620998c196-task#0' status to FAILED",
        "type": "string"
    },
    "TimeGenerated": {
        "value": "2025-06-26T17:28:46.145217Z",
        "type": "datetime"
    },
    "Level": {
        "value": "Error",
        "type": "string"
    },
    "Category": {
        "value": "Error",
        "type": "string"
    },
    "ResourceId": {
        "value": "",
        "type": "string"
    },
    "SubscriptionId": {
        "value": "",
        "type": "string"
    },
    "ResourceGroup": {
        "value": "",
        "type": "string"
    },
    "JobName": {
        "value": "",
        "type": "string"
    },
    "OperationName": {
        "value": "",
        "type": "string"
    },
    "Status": {
        "value": "Error",
        "type": "string"
    },
    "Source": {
        "value": "",
        "type": "string"
    },
    "TypeProperty": {
        "value": "Error",
        "type": "string"
    },
    "DataErrorType": {
        "value": "",
        "type": "string"
    },
    "ErrorCategory": {
        "value": "Error",
        "type": "string"
    },
    "BriefMessage": {
        "value": "",
        "type": "string"
    },
    "Message": {
        "value": "Task: '19d01fad-a58e-4bfa-8a4b-3c620998c196-task#0' failed. Details: org.apache.kafka.connect.errors.ConnectException: Failed to create and start Camel context\nCaused by: com.azure.core.exception.AzureException: Could not create the ServiceBusSharedKeyCredential.\nCaused by: java.lang.IllegalArgumentException: 'policyName' cannot be an empty string.",
        "type": "string"
    },
    "FromTimestamp": {
        "value": null,
        "type": "datetime"
    },
    "ToTimestamp": {
        "value": null,
        "type": "datetime"
    },
    "EventCount": {
        "value": 0,
        "type": "long"
    },
    "GroupSize": {
        "value": 1,
        "type": "long"
    }
}

[Rufyda]

Hi,

Thanks for sharing the detailed context. Based on the error message:

java.lang.IllegalArgumentException: 'policyName' cannot be an empty string.

it indicates that the Shared Access Policy Name (policyName) used in the Azure Service Bus connection is missing or not properly passed to the connector. Even if the key itself is correct, the policy name is a required field to authenticate properly.

Recommendations:
Verify Connection Configuration:

Double-check that both the Shared Access Policy Name and Key are correctly entered in the connection settings within the Manage Connections and Gateways screen.

Since the EventStream UI does not currently support selecting the on-premises data gateway, make sure the gateway is explicitly associated with the connection in the Manage Connections area.

Use the Latest Connector Version:

Ensure you are using the most recent version of the EventStream Azure Service Bus connector, as some earlier versions may have issues with gateway integration or authentication.

Check Gateway Permissions and Network:

Confirm the on-premises data gateway has the necessary permissions and network access to reach the Azure Service Bus endpoint without public access.

Service Principal Authentication:

Currently, Shared Access Key authentication is the standard method supported for Azure Service Bus in EventStream.

There is growing demand for Service Principal authentication support; I recommend submitting a feature request through Microsoft Fabric feedback channels. This would enhance security by enabling managed identities and avoid key management overhead.

If this answered your question, please consider clicking Accept Answer and Yes if you found it helpful.
If you have any other questions or need further assistance, feel free to let us know — we’re here to help.

[V-yubandi-msft]

Hi @to-know-better ,

I hope my response was helpful. Did it resolve your issue, or have you also submitted this as a suggestion in the Ideas forum?

Thank You.

[v-sdhruv]

Hi @to-know-better  ,
I hope you were successfully able to raise the idea in ideas forum?
We would be closing this thread. If you have any questions, feel free to post your query in a seperate ticket and we would be happy to assist you.

Thank you

[V-yubandi-msft]

Hi @to-know-better ,

I hope my message clarified everything. If your issue is resolved, please mark it as the Accepted Solution. If not, let me know whether you have shared your idea in the Ideas Forum.

Thank you.

[V-yubandi-msft · Accepted solution]

Hi @to-know-better ,

Thank you for engaging with the Microsoft Fabric Community. Eventstream couldn’t read the Shared Access Policy Name correctly from your connection settings. This issue often arises when setting up the connection via Manage Connections and Gateways, where required fields like the policy name may not be passed through properly.

Please check the following

1. Verify that the Shared Access Key Name (policy name) is entered correctly

2. Ensure the key value is accurate

3. Confirm your on premises data gateway is installed and configured correctly

Additionally, the Eventstream UI currently doesn’t allow you to select a gateway directly when configuring an Azure Service Bus source. This has been noted by other users, although it’s not yet documented.

Lastly, please note that Service Principal authentication is not supported for ASB connections in Eventstream at this time. If you’d like this feature, you can suggest or vote for it in the Fabric Ideas portal.

Link: Fabric Ideas - Microsoft Fabric Community

For more details, please check the official Microsoft documentation.
Add Azure Service Bus source to an eventstream - Microsoft Fabric | Microsoft Learn
Add and manage eventstream destinations - Microsoft Fabric | Microsoft Learn

I hope this helps. If you find this solution useful, please consider marking it as the accepted answer so it’s easier for others to discover in the community.