Forum Discussion
Impactful IndividualPreview Features - Databricks
Hi,
The "Use legacy Databricks connector implementation" option allows Power BI to use the older Databricks connector implementation based on the Simba Spark ODBC driver.
Microsoft is transitioning to a newer implementation based on Arrow Database Connectivity (ADBC), which is designed to provide more efficient data transfer, particularly for larger datasets.
The legacy option is mainly intended for backward compatibility, especially if you experience issues with the newer implementation.
For new connections, the ADBC implementation is generally recommended.
You can also explicitly select ADBC in Power Query M by specifying Implementation="2.0" in the connector options.
For more information, see Microsoft's documentation:
- If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.
Super UserHi,
The "Use legacy Databricks connector implementation" option allows Power BI to use the older Databricks connector implementation based on the Simba Spark ODBC driver.
Microsoft is transitioning to a newer implementation based on Arrow Database Connectivity (ADBC), which is designed to provide more efficient data transfer, particularly for larger datasets.
The legacy option is mainly intended for backward compatibility, especially if you experience issues with the newer implementation.
For new connections, the ADBC implementation is generally recommended.
You can also explicitly select ADBC in Power Query M by specifying Implementation="2.0" in the connector options.
For more information, see Microsoft's documentation:
- If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.