Forum Discussion

AKemper's avatar
AKemper
Frequent Visitor
11 months ago

Databricks Connection Fails Only in Fabric Pipeline

Hello all!   I am trying to create a Pipeline to get data from my Azure Databricks environment. I have an existing connection that I have used with Dataflows and Semantic Models before that works w...
Need Help
BeaBF's avatar
BeaBF
Icon for Super User rankSuper User
11 months ago

AKemper ok, in Copy Data, Databricks SQL endpoint is not exposed as a first-class source in some versions of ADF/Synapse.

 

Try to use a JDBC/ODBC connector to query the SQL endpoint

  • Copy Data activity can use generic JDBC instead of the Azure Databricks connector.

  • Example JDBC URL for a SQL endpoint:

jdbc:spark://<ServerHostname>:443/default;
transportMode=http;
ssl=1;
httpPath=<HTTPPath>;
AuthMech=3;
UID=token;
PWD=<PAT> 
 
BBF

💡 Did I answer your question? Mark my post as a solution!

👍 Kudos are appreciated

🔥 Proud to be a Super User!

AKemper's avatar
AKemper
Frequent Visitor
11 months ago

BeaBF I am now getting the below error message regarding the UID param in the connection string.

 

An exception occurred: ODBC: The connection string is invalid. The connection property 'uid' can only be provided using credentials.