Forum Discussion

yoshihirok's avatar
yoshihirok
Icon for Post Prodigy rankPost Prodigy
8 years ago
Solved

Can I connect Azure Databricks from Power BI Desktop by DirectQuery?

I want to know, Can I connect Azure Databricks from Power BI Desktop by DirectQuery? Currently, the data sources for DirectQuery support Apache Spark on Azure HDInsight and Spark. https://docs.mi...
Need Help
  • v-frfei-msft's avatar
    v-frfei-msft
    8 years ago

    Hi yoshihirok,

     

    Power BI Desktop can be connected directly to an Azure Databricks cluster using the built-in Spark connector (Currently in preview). The connector enables the use of DirectQuery to offload processing to Databricks. For more details, please check the online document.

     

    Regards,

    Frank

v-frfei-msft's avatar
v-frfei-msft
Icon for Community Support rankCommunity Support
8 years ago

Hi yoshihirok,

 

Power BI Desktop can be connected directly to an Azure Databricks cluster using the built-in Spark connector (Currently in preview). The connector enables the use of DirectQuery to offload processing to Databricks. For more details, please check the online document.

 

Regards,

Frank

  • yoshihirok's avatar
    yoshihirok
    Icon for Post Prodigy rankPost Prodigy
    8 years ago

    Thank you v-frfei-msft for your nice information

     

    Awesome, Power BI Desktop can connect the data on Azure Databricks as DirectQuery

    Just, I'm looking the information for share with partners, friends.

     

    Yes, I will check the online document about Power BI Desktop and Azure Databriks.

    and, I hope to add the Azure Databricks to data source supported by DirectQuery.

     

    Regards,

    Yoshihiro Kawabata

  • Anonymous's avatar
    Anonymous
    Not applicable
    7 years ago

    The Spark connector is very slow....

     

    Queries in Azure Databricks are very fast less than 200ms, but data takes more than 10s to arrive to PowerBI Desktop...

     

    Can I do anything to optimize performance?

     

    Thank you,

    Miguel

    • Anonymous's avatar
      Anonymous
      Not applicable
      7 years ago

      This an example of the query on Dax Studio:

       

       

      This is the timings of the Azure Databricks server for the same querie:

       

       

       

       

      Can someone explain me why is so slow.....

       

      And its not a network problem, because if you run it from PowerBi Online it will take the same time...

       

      Thank you,

      Miguel

      • djd's avatar
        djd
        New Member
        7 years ago

        I'm witnessing the same behaviour; < 2 seconds in Databricks and 10 - 20 seconds in Power BI.  Have spent many hours trying to troublehsoot unsuccessfully.