Reply
Jy
Microsoft Employee
Microsoft Employee

Is LakeHouse required to run SparkSQL queries?

I have a notebook running with Spark SQL queries. I do not have a Lakehouse attached. Seeing the error "Spark SQL queries are only possible in the context of a lakehouse. Please attach a lakehouse to proceed" when trying to run the Spark SQL query. 

 

Are there options to run this without attaching the Lakehouse?

1 ACCEPTED SOLUTION
frithjof_v
Super User
Super User

Hi @Jy 

 

In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.

 

I did it by using the abfss path to create a dataframe of my data.

 

Then I used this dataframe as the source to create a temporary view.

 

Then I could use the temporary view for doing Spark SQL.

 

https://community.fabric.microsoft.com/t5/Data-Engineering/Mounting-NB-on-the-fly/m-p/4057425/highli...

View solution in original post

2 REPLIES 2
frithjof_v
Super User
Super User

Hi @Jy 

 

In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.

 

I did it by using the abfss path to create a dataframe of my data.

 

Then I used this dataframe as the source to create a temporary view.

 

Then I could use the temporary view for doing Spark SQL.

 

https://community.fabric.microsoft.com/t5/Data-Engineering/Mounting-NB-on-the-fly/m-p/4057425/highli...

v-huijiey-msft
Community Support
Community Support

Hi @Jy ,

 

Running Spark SQL queries in Fabric does require attaching lakehouse.

 

Unfortunately, there is no other option to run Spark SQL queries in Fabric Lakehouse notebooks without attaching a lakehouse.Lakehouse provides the necessary context and storage for executing these queries.

 

If you want to run Spark SQL queries, attach a Lakehouse.

 

Best Regards,
Yang
Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

avatar user

Helpful resources

Announcements
MarchFBCvideo - carousel

Fabric Monthly Update - March 2025

Check out the March 2025 Fabric update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)