Forum Discussion

AKemper's avatar
AKemper
Frequent Visitor
11 months ago

Databricks Connection Fails Only in Fabric Pipeline

Hello all!   I am trying to create a Pipeline to get data from my Azure Databricks environment. I have an existing connection that I have used with Dataflows and Semantic Models before that works w...
Need Help
AKemper's avatar
AKemper
Frequent Visitor
11 months ago

BeaBF Thank you for the quick reply!

 

In Copy Data when selecting a source the only Databricks option I have is Azure Databricks which is what is giving me the error.

 

 

Thank you!

BeaBF's avatar
BeaBF
Super User
11 months ago

AKemper ok, in Copy Data, Databricks SQL endpoint is not exposed as a first-class source in some versions of ADF/Synapse.

 

Try to use a JDBC/ODBC connector to query the SQL endpoint

  • Copy Data activity can use generic JDBC instead of the Azure Databricks connector.

  • Example JDBC URL for a SQL endpoint:

jdbc:spark://<ServerHostname>:443/default;
transportMode=http;
ssl=1;
httpPath=<HTTPPath>;
AuthMech=3;
UID=token;
PWD=<PAT> 
 
BBF

💡 Did I answer your question? Mark my post as a solution!

👍 Kudos are appreciated

🔥 Proud to be a Super User!

  • AKemper's avatar
    AKemper
    Frequent Visitor
    11 months ago

    BeaBF I am now getting the below error message regarding the UID param in the connection string.

     

    An exception occurred: ODBC: The connection string is invalid. The connection property 'uid' can only be provided using credentials.