Forum Discussion

Luuk_J's avatar
Luuk_J
Frequent Visitor
2 years ago
Solved

Spark connector import error in notebook

Hi all,

 

Just getting started with the Fabric notebooks and trying to load a view from the Lakehouse SQL endpoint as per: https://learn.microsoft.com/en-us/fabric/data-engineering/spark-data-warehouse-connector

 

However, during the required imports I get the following error:

 

The first line succeeds, second line throws the error. I'm (as per documentation) using Spark (Scala) in that cell.
Any suggestions how to fix this?

Thanks in advance!

Luuk

 

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Luuk_J 

     

    You are not importing the correct module. The correct one is as below.

    Important

    Run these import statements at the beginning of your notebook or before you start using the connector:

    import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._

    import org.apache.spark.sql.functions._

     

    Best Regards,
    Jing
    If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Luuk_J 

     

    You are not importing the correct module. The correct one is as below.

    Important

    Run these import statements at the beginning of your notebook or before you start using the connector:

    import com.microsoft.spark.fabric.tds.implicits.read.FabricSparkTDSImplicits._

    import org.apache.spark.sql.functions._

     

    Best Regards,
    Jing
    If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

    • Luuk_J's avatar
      Luuk_J
      Frequent Visitor

      Ah my bad, must have mixed up several things in the process. Thanks for the quick reply, the import is working correctly now!