Forum Discussion

jmangana's avatar
jmangana
New Member
10 years ago
Solved

Connectivity with DataBricks / Spark?

has anyone used the Power BI solution with a DataBricks implementation?  Please advise.  Thanks.  
Need Help
mllopis's avatar
mllopis
Community Admin
10 years ago

Hi jmangana,

 

We recently added a new connector to Power BI Desktop that allows users to connect to their Spark clusters. Please check the September Update announcement for more details:

http://blogs.msdn.com/b/powerbi/archive/2015/09/23/44-new-features-in-the-power-bi-desktop-september-update.aspx

 

Have you had a chance to try this new connector? If so, we would be interested in hearing about how was your experience with it.

 

Thanks,
M.

  • KirkNason's avatar
    KirkNason
    Advocate I
    10 years ago

    Do you know if the the connector is via DirectQuery or does it import the data into the model.
    We are looking to use the power of the Spark Cluster to handle the queries, similar to the SSAS Tabular connector

    • syepes's avatar
      syepes
      New Member
      10 years ago

      Hello,

       

      I have managed to connect Power BI to our own in house cluster Spark.

      You actually need to use the HiveThriftServer2 to use Spark with Power BI.

       

      Setup:

      • Install Spark ODBC: http://go.microsoft.com/fwlink/?linkid=616229&clcid=0x409*
      • Setup a ODBC (e.g. SPARKMS) with the host:10000 of the server thats running the Hive Thrift Server
      • Start Power Bi a using ODBC DataSource with the prevously created ODBC: dsn=SPARKMS
      • Input the SparkSQL you whant to work with..

       

      Note that this does not really work will with very big datasets...

       

       

      Regards and hope this helps.