Forum Discussion

maxbarj's avatar
maxbarj
Icon for Advocate I rankAdvocate I
1 year ago
Solved

Trying to play with new ADBC Azure Databricks connector

Hello,

 

I have added in my Databricks function 

Implementation="2.0"

 

as adviced here: https://learn.microsoft.com/en-gb/power-query/connectors/databricks-azure#arrow-database-connectivity-driver-connector-implementation-preview

 

 

I'm calling this function in each of my source queries as followed.

But instead of returning the result of the SQL query, it lists the databases.

 

 

 

Any idea on how to fix the Databricks function ?

 

Thanks !

  • maxbarj's avatar
    maxbarj
    11 months ago

    Hello,

     

    I confirm it works fine now.

    In fact, following the ticket I have raised to Microsoft Support team, Databricks team have fixed the driver in september version of Power BI desktop ๐Ÿ™‚

14 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,

     

    Thank you for reaching out to the Microsoft Fabric Forum Community.

     

    You're currently using the Databricks.Query() function, which just shows a list of databases instead of running your SQL query. To fix this, you need to use the Databricks.Execute() function instead. This function lets you directly run a SQL query on your Databricks connection. You also need to pass the host name, SQL endpoint, your actual query text, and options like the catalog and implementation version. Try Replace the below query inside the quotes with your own.

     

    Databricks.Execute(HostName, SqlEndPoint,
    "SELECT col1, col2 FROM ds_rt_admin.data_area_xyz",
    [Catalog = Databricks_Catalog, Implementation = "2.0"])


    Best regards,
    Prasanna Kumar

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,


    Apologies for the confusion in my earlier response I appreciate your patience.

    You're absolutely right there is no official Databricks.Execute() function in Power Query. That was a mistake on my part.

    The correct approach, as per Microsoft documentation for Databricks + Power BI with Implementation = "2.0", is to use the Databricks.Query() function and pass your SQL inside the Query field like below.

    Databricks.Query(HostName,SqlEndPoint,[Catalog = Databricks_Catalog,
    Query = "SELECT * FROM your_table",Implementation = "2.0"])

    Again, apologies for the confusion caused earlier. I hope this clears it up, and let me know if you need help adjusting your existing queries.

     

    Thanks & Regards,

    Prasanna Kumar

    • maxbarj's avatar
      maxbarj
      Icon for Advocate I rankAdvocate I

      Hello Anonymous 

       

      Solution does not work unfortunately.

       

      It seems query option inside the brackets is not evaluated by power query:

       

       

      Here is the result if I try to define the Query option outside the brackets:

       

       

      Thank you for your support

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,

     

    Just checking, have you had a chance to open a support ticket, as suggested. If so, we'd love to hear the current status or any updates from that.

    If the issue was resolved through the support ticket, it would be great if you could share the solution here as well. It could really help other community members find answers more quickly.

     

    Warm regards,
    Prasanna Kumar

    • maxbarj's avatar
      maxbarj
      Icon for Advocate I rankAdvocate I

      Hi,

       

      No, I haven't got time to create the support ticket yet.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,

     

    Just checking, have you had a chance to open a support ticket, as suggested. If so, we'd love to hear the current status or any updates from that.

     

    Regards,

    Prasanna Kumar

    • maxbarj's avatar
      maxbarj
      Icon for Advocate I rankAdvocate I

      Hi Anonymous ,

       

      I have just opened a support ticket, I will keep you posted here.

       

      Kind regards,

      Maxence

  • Power BI support team informed me they have managed to reproduce the issue and have transfered the case to Databricks team for investigation.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,

     

    Thank you for the update. If possible, please share any progress and updates from the Databricks team here as they become available. It will help other community members who are facing the similar issues.

     

    Thanks & Regards,

    Prasanna kumar

  • Hi,

    I tried this directly with NativeQuery connector  & seem to work for me:

    "M" Query template below:

    let 
        data = Value.NativeQuery(Databricks.Catalogs(<DatabricksServerName>, <DatabricksHTTPPath>, [Catalog=<DatabricksDatabase>, Implementation="2.0"]){[Name=<DatabricksDatabase>,Kind="Database"]}[Data],"  
    โ€ƒโ€ƒSelect ... From table A Join B On... WHERE  .. 
    ", null, [EnableFolding=true]) 
    in data

     

    Or Is yours a different issue?

     

    • maxbarj's avatar
      maxbarj
      Icon for Advocate I rankAdvocate I

      Hello,

       

      I confirm it works fine now.

      In fact, following the ticket I have raised to Microsoft Support team, Databricks team have fixed the driver in september version of Power BI desktop ๐Ÿ™‚

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi maxbarj,

     

    Thank you for the update. Could you please accept the specific response that helped resolve the issue. This will assist other community members who may face the same problem.

     

    Thanks & Regards,

    Prasanna Kumar