Forum Discussion
Spark connector import error in notebook
Hi all,
Just getting started with the Fabric notebooks and trying to load a view from the Lakehouse SQL endpoint as per: https://learn.microsoft.com/en-us/fabric/data-engineering/spark-data-warehouse-connector
However, during the required imports I get the following error:
The first line succeeds, second line throws the error. I'm (as per documentation) using Spark (Scala) in that cell.
Any suggestions how to fix this?
Thanks in advance!
Luuk
- Anonymous2 years ago
Hi Luuk_J
You are not importing the correct module. The correct one is as below.
Important
Run these import statements at the beginning of your notebook or before you start using the connector:
import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._import org.apache.spark.sql.functions._Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!
2 Replies
- AnonymousNot applicable
Hi Luuk_J
You are not importing the correct module. The correct one is as below.
Important
Run these import statements at the beginning of your notebook or before you start using the connector:
import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._import org.apache.spark.sql.functions._Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!- Luuk_JFrequent Visitor
Ah my bad, must have mixed up several things in the process. Thanks for the quick reply, the import is working correctly now!