Forum Discussion
Is LakeHouse required to run SparkSQL queries?
I have a notebook running with Spark SQL queries. I do not have a Lakehouse attached. Seeing the error "Spark SQL queries are only possible in the context of a lakehouse. Please attach a lakehouse to proceed" when trying to run the Spark SQL query.
Are there options to run this without attaching the Lakehouse?
Hi Jy
In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.
I did it by using the abfss path to create a dataframe of my data.
Then I used this dataframe as the source to create a temporary view.
Then I could use the temporary view for doing Spark SQL.
2 Replies
- frithjof_vCommunity Champion
Hi Jy
In my experience, you can use Spark SQL without attaching a Lakehouse to the Notebook.
I did it by using the abfss path to create a dataframe of my data.
Then I used this dataframe as the source to create a temporary view.
Then I could use the temporary view for doing Spark SQL.
- AnonymousNot applicable
Hi Jy ,
Running Spark SQL queries in Fabric does require attaching lakehouse.
Unfortunately, there is no other option to run Spark SQL queries in Fabric Lakehouse notebooks without attaching a lakehouse.Lakehouse provides the necessary context and storage for executing these queries.
If you want to run Spark SQL queries, attach a Lakehouse.
Best Regards,
Yang
Community Support TeamIf there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!