topic Re: Azure Databricks Connector vs Partner Connect in Desktop

Azure Databricks Connector vs Partner Connect

jakaihammuda — Fri, 12 Apr 2024 12:17:58 GMT

Hello,

We are newly adopting Azure Datbricks as our platform for data.

Im researching and testing the best method of connection for furture PowerBI reports.

What im strugling to see a difference in, is between connecting to Clusters or an SQL Warehouse, through Partner Connect / Azure Databricks connector (manually in PBI)?

They both provide the correct connection details

Both support Import/Direct Query (we will typially only be using import)

I cannot see a significant difference as to why one would be used over the other? We do not need a gateway configured also for either.

Is anybody able to provide any of level of expertise as to why one is preferred over the other?

Re: Azure Databricks Connector vs Partner Connect

Anonymous — Fri, 12 Apr 2024 13:00:05 GMT

I have seen both used and it seems to be the preference of the developer.
I would watch the monthly new features (Power BI Blog—Updates and News | Microsoft Power BI) for changes to either (updates). Also, watch out for Databrick blogs to find the direction Microsoft is trying to lead you to.

Connect Power BI to Databricks | Databricks on AWS
Connect Power BI to Azure Databricks - Azure Databricks | Microsoft Learn

Re: Azure Databricks Connector vs Partner Connect

jakaihammuda — Fri, 12 Apr 2024 13:06:03 GMT

Thank you for your reply!

Yeah ill keep an eye out. doesnt really seem to be much out there which gives a clear definition as to why there are both options.

While I have you here Anonymous , on the topic of Databricks with PowerBI. Is query folding no applicable when connceting to Azure Databricks?

Ive seen many people frustrated about it, only seen one post that provdes a "workaround" that failed to work for me....cant conlude if its something that can be enabled or not..

this was the post i saw Query Folding Azure Databricks (linkedin.com)

Re: Azure Databricks Connector vs Partner Connect

Anonymous — Fri, 12 Apr 2024 13:11:13 GMT

Yeah, none of those posts are verified by someone from Microsoft.

Here is the team I would watch about databricks connectors
Advancing Spark - Power BI Databricks Connector with Native SQL (youtube.com)