Forum Discussion
Databricks Connection Fails Only in Fabric Pipeline
Hello all! I am trying to create a Pipeline to get data from my Azure Databricks environment. I have an existing connection that I have used with Dataflows and Semantic Models before that works w...
AKemper Hi!
Try to use the Azure Databricks (SQL) connector instead of the regular Databricks connector
-
In Copy Data, when selecting the source, choose:
-
Source type → Databricks (SQL endpoint)
-
Provide the server hostname, HTTP path, and PAT.
-
-
This treats it like a SQL source rather than a cluster-based notebook source.
-
This should work exactly like Dataflows do
BBF
💡 Did I answer your question? Mark my post as a solution!
👍 Kudos are appreciated
🔥 Proud to be a Super User!
BeaBF Thank you for the quick reply!
In Copy Data when selecting a source the only Databricks option I have is Azure Databricks which is what is giving me the error.
Thank you!
AKemper ok, in Copy Data, Databricks SQL endpoint is not exposed as a first-class source in some versions of ADF/Synapse.
Try to use a JDBC/ODBC connector to query the SQL endpoint
-
Copy Data activity can use generic JDBC instead of the Azure Databricks connector.
-
Example JDBC URL for a SQL endpoint:
jdbc:spark://<ServerHostname>:443/default;transportMode=http;ssl=1;httpPath=<HTTPPath>;AuthMech=3;UID=token;PWD=<PAT>BBF
💡 Did I answer your question? Mark my post as a solution!
👍 Kudos are appreciated
🔥 Proud to be a Super User!
-
