Azure Databricks connection issues from PowerBI Service via VNET Gateway

[Ronald_ed]

Hello All,

We are trying to create connection from PowerBI Service to Azure Databricks with our VNET Gateway. 

Current Status:
- We can connect to Azure Databricks from PowerBI Desktop

- We can create a connection type - Azure Databricks Workspace but not Azure Databricks 

- We can publish Dataset directly from Azure Databricks to PowerBI Service - but not able to authenticate user. 

Error message when we try to create connection with VNET GW - connection type Azure Databricks (Azure Databricks Workspace works) 
Details: vnet-aut-dbx-aut-powerbi-dev-westeurope-snet-aut-dbx-aut-powerbi-01-dev-westeurope: ODBC: ERROR [HY000] [Microsoft][ThriftExtension] (14) Unexpected response from server during a HTTP connection: SSL_connect: certificate verify failed.

Authentication Error after I published dataset from Azure Databricks directly to PowerBI Service (for all auth. methods): 
Failed to update data source credentials: ODBC: ERROR [HY000] [Microsoft][ThriftExtension] (14) Unexpected response from server during a HTTP connection: Bad Status: Unrecognized response:HTTP/1.1 302 Found.

Thank you for help 

[Ronald_ed · Accepted solution]

Hello, I solved the issue. Problem was with the certificates from Azure Databricks. I downloaded the certificate from the browser and then I´ve installed it on the server where the GW is. After this, I was able to create a connection from PowerBI Service to Azure Databricks with On premise data GW. 

[data_eng]

Hi, but where to install the certificate when using a VNET instead of an on-prem gateway? Also which connection type did you use for the on prem gateway

[Ronald_ed]

@data_eng When you use a VNET GW you have to whitelist this url - cacerts.digicert.com (192.229.221.95) VNET will download all necessary certificates to successfully connect to the DBX.

[v-shex-msft]

Hi @Ronald_ed,
Perhaps you use REST API to getting data from azure data bricks with anonymous authorizations, they should not require you to configure VNET settings.

Azure Databricks REST APIs | Microsoft Learn

Regards,

Xiaoxin Sheng

[Ronald_ed]

Hello @v-shex-msft,

thank you for quick reply. Unfortunately, after some discussions with our security department we agreed on to use VNET gateway for such a connection. I would try to fix the VNET issues first.

Regards,

Ronald