Forum Discussion
tkiwi
Helper I
Helper ISpark Temp View with two Lakehouses
Hey there, I`ve got the following situation Notebook with SparkSQL, the following SELECT is running SELECT * FROM LH1.dbo.table1 t1
JOIN LH2.dbo.table2 t2
ON t1.columnID = t2.columnID The fol...
Found a reason by another post on reddit...Spark views are currently not supported:
smpa01
Community Champion
Community Championtkiwi temporary views in spark are session-scoped; meaning they are short lived and don't exists beyond the scope of the query. If you are expecting to create a view with the hope that it shows up in table section of lakehouse tables, that is not the intended use of the TEMPORRY VIEW
fabric notebook has full support for them; try the following
spark.sql("create or replace temporary view temp_view_1 as select 1 as colA")
df = spark.sql(f"select * from temp_view_1")
df.show()