Trying to play with new ADBC Azure Databricks connector

[maxbarj]

Hello,

I have added in my Databricks function 

Implementation="2.0"

as adviced here: https://learn.microsoft.com/en-gb/power-query/connectors/databricks-azure#arrow-database-connectivit...

I'm calling this function in each of my source queries as followed.

But instead of returning the result of the SQL query, it lists the databases.

Any idea on how to fix the Databricks function ?

Thanks !

[v-pgoloju]

Hi @maxbarj,

Thank you for the update. If possible, please share any progress and updates from the Databricks team here as they become available. It will help other community members who are facing the similar issues.

Thanks & Regards,

Prasanna kumar

[maxbarj]

Power BI support team informed me they have managed to reproduce the issue and have transfered the case to Databricks team for investigation.

[v-pgoloju]

Hi @maxbarj,

Just checking, have you had a chance to open a support ticket, as suggested. If so, we'd love to hear the current status or any updates from that.

Regards,

Prasanna Kumar

[maxbarj]

Hi @v-pgoloju ,

I have just opened a support ticket, I will keep you posted here.

Kind regards,

Maxence

[v-pgoloju]

Hi @maxbarj,

Just checking, have you had a chance to open a support ticket, as suggested. If so, we'd love to hear the current status or any updates from that.

If the issue was resolved through the support ticket, it would be great if you could share the solution here as well. It could really help other community members find answers more quickly.

Warm regards,
Prasanna Kumar

[maxbarj]

Hi,

No, I haven't got time to create the support ticket yet.

[v-pgoloju]

Hi @maxbarj,

If the issue still persists, I’d recommend raising a support ticket with Microsoft. The support team can look into the backend and provide more in-depth assistance tailored to your environment.
https://learn.microsoft.com/en-us/power-bi/support/create-support-ticket

Thanks & Regards,

Prasanna Kumar

[v-pgoloju]

Hi @maxbarj,

Apologies for the confusion in my earlier response I appreciate your patience.

You're absolutely right there is no official Databricks.Execute() function in Power Query. That was a mistake on my part.

The correct approach, as per Microsoft documentation for Databricks + Power BI with Implementation = "2.0", is to use the Databricks.Query() function and pass your SQL inside the Query field like below.

Databricks.Query(HostName,SqlEndPoint,[Catalog = Databricks_Catalog,
Query = "SELECT * FROM your_table",Implementation = "2.0"])

Again, apologies for the confusion caused earlier. I hope this clears it up, and let me know if you need help adjusting your existing queries.

Thanks & Regards,

Prasanna Kumar

[maxbarj]

Hello @v-pgoloju 

Solution does not work unfortunately.

It seems query option inside the brackets is not evaluated by power query:

Here is the result if I try to define the Query option outside the brackets:

Thank you for your support

[v-pgoloju]

Hi @maxbarj,

Thank you for reaching out to the Microsoft Fabric Forum Community.

You're currently using the Databricks.Query() function, which just shows a list of databases instead of running your SQL query. To fix this, you need to use the Databricks.Execute() function instead. This function lets you directly run a SQL query on your Databricks connection. You also need to pass the host name, SQL endpoint, your actual query text, and options like the catalog and implementation version. Try Replace the below query inside the quotes with your own.

Databricks.Execute(HostName, SqlEndPoint,
"SELECT col1, col2 FROM ds_rt_admin.data_area_xyz",
[Catalog = Databricks_Catalog, Implementation = "2.0"])

Best regards,
Prasanna Kumar

[maxbarj]

Hi @v-pgoloju 

Thank you for your reply.

Unfortunately the solution proposed does not work:

I didn't find any documentation on the function Databricks.Execute()

I'm using a custom SQL Query as detailed here: https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi#using-a-custom-sql-query

Without the option 

Implementation = "2.0"

The function works fine and return the result of the SQL query.

Kind regards,