PBI Dataflows failed connection to Azure Databricks using MS Data Gateway

[kkitsara]

Hello,

We are trying to create a dataflow using Azure Databricks connector with OAuth login (AAD) and MS on-premise Data Gateway.

The steps we follow:

1. Create a dataflow

2. Select Azure Databricks as connector

3. Add hostname and HTTP path

4. Select our MS on-premise Data Gateway

5. Use Azure Active Directory as authenticator

6. Sign In

When we click sign in we get the below error:

Unable to create connection using an organizational account, please check to see if the data source path is correct and that the data source supports using an organizational account. (Session ID: 59340d90-2f52-4721-ace3-2056eab6a34f, Region: europe)

When we try without the MS Data Gateway it works.

When we try with the MS Data Gateway and with PAT authentication it works.

What do we miss here? Is there any missing MS Data Gateway configuration?

Additionally we try to create a connection directly on PBI service as per below:

1. Go to settings

2. Select Manage Connections and Gateways

3. Create New

4. Select on-premises connections

5. Select Azure Databricks as connector

6. Input the hostname and HTTP path

7. Select the MS on-premise data gateway

8. Select Azure Active Directory as authentication method

9. Click Edit Credentials

We get the below error

What do we miss here?

If I create a cloud connection with automatic proxy discovery enabled it works.

Regards,

Konstantinos

[v-pagayam-msft]

Hi @kkitsara ,
Thank you for reaching out to the Microsoft Fabric Community Forum about the issue you are encountering.

Upon reviewing the provided information, below steps may assist you addressing the issue.

• Ensure that the organizational account being used has the necessary permissions to access the data source.
• Make sure that the MS Data Gateway is properly configured to handle OAuth authentication.
• If OAuth login continues to fail, consider using PAT authentication as a temporary workaround while investigating the issue further.

Please refer the solved link for more understanding, this might help you.
Solved: PBI Gateway to Azure Databricks Connection Error: ... - Microsoft Fabric Community

If this post helps, please give us Kudos and consider Accept as a solution to help the other members find it more quickly.

[kkitsara]

Hi @v-pagayam-msft 

Thanks for your reply.

Have some follow-up queries on your bullet points.

• Which is the organizational account? Is it the Azure Subscription where the PBI service belongs to?
• How can I ensure that the MS Data Gateway is configured to handle OAuth authentication? Do you have reference documentation for this? I struggle to find something relevant.

Thanks for assisting.

Regards,

Kostas

[v-pagayam-msft]

Hi @kkitsara ,

Thank you for your follow-up questions. I'm happy to provide more details to help you resolve the issue.

• The organizational account refers to the Azure Active Directory (AAD) account used to authenticate and access resources within your organization. This is typically the account you use to log in to Azure services and Power BI. It is associated with your AAD tenant rather than a specific Azure Subscription.
• Configuring MS Data Gateway for OAuth Authentication:
  • To ensure that the MS Data Gateway is configured to handle OAuth authentication, please follow these steps:
    1. Ensure your on-premises data gateway is up-to-date. You can download the latest version from the Microsoft Download Center.
    2. In the Power BI service, go to Settings > Manage Gateways. Select your gateway and verify that it is configured correctly.
    3. Check the gateway is set up to support OAuth authentication. This might involve configuring the gateway to use the correct authentication method and ensuring it can communicate with Azure AD.

Hope this helps, if so,please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

[kkitsara]

Hello @v-pagayam-msft 

Thanks again for your follow-up.

Points 1 and 2 are already checked.

Also our App registration used for OAuth integration is on the same account with PBI service.

Databricks is on AWS, but we are using Azure Databricks connector (as suggested on MSFT documentation)

Could you please clarify more about point 3?

Check the gateway is set up to support OAuth authentication. This might involve configuring the gateway to use the correct authentication method and ensuring it can communicate with Azure AD.

What kind of configuration is needed?

Regards,

Kostas

[v-pagayam-msft · Accepted solution]

Hi  @kkitsara ,
Thanks again for your patience and for providing more details! I’d be happy to clarify how to check if the On-Premises Data Gateway is set up to support OAuth authentication and what configurations might be needed.

Not all data sources support OAuth passthrough when using the On-Premises Data Gateway.
Power BI Data Gateway – Supported Data Sources

If OAuth authentication is not supported for Azure Databricks via the On-Premises Data Gateway, you may need to use Personal Access Token (PAT) or Service Principal authentication instead.

Since OAuth authentication requires Azure Active Directory (AAD) login, the On-Premises Data Gateway must be able to connect to Azure AD endpoints without network restrictions.

If your organization uses a proxy, make sure the gateway is configured to work with it:
How to Configure Proxy for On-Premises Data Gateway

If this information is helpful, please “Accept it as a solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
Thank you.

[kkitsara]

Hello,

I am using Azure Active Directory for OAuth from Azure Databricks Connector

I am not using any PAT and any service principal.

The idea is to sign in with my user identity and read only the data I have access.

The Databricks account is on AWS and as said dataflow authentication works without Data Gateway but does not work with Data Gateway.

Regards,

Kostas

[Deku]

Is the PAT token from the same account you are using for oauth? What type of account are you using for Auth?