Forum Discussion

jjaeger94's avatar
jjaeger94
Icon for Helper II rankHelper II
2 years ago

Apache Spark Connector for Delta Sharing

This seems to be a pre-requisite for loading data from a delta share into a spark df.  However, I have had difficulty installing this within Fabric.  Has anyone come across this and been able to ov...
data engineering
notebook
Spark Job Definition
v-cboorla-msft's avatar
v-cboorla-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hi jjaeger94 

 

Thanks for using Microsoft Fabric Community.

 

The Apache Spark Connector for Delta Sharing isn't a separate installation within Microsoft Fabric. The connector is pre-installed within the Fabric runtime itself. The Spark connector for Microsoft Fabric data warehouses enables Spark developers and data scientists to access and work with data from a data warehouse and the SQL analytics endpoint of a lakehouse. 

For additional information please refer : Spark connector for Microsoft Fabric data warehouses

 

I hope this information helps.

 

Thank you.

 

jjaeger94's avatar
jjaeger94
Icon for Helper II rankHelper II
2 years ago

This appears to be for datawarehouses. My connection is specifically to a Delta Share.