Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Learn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now

Reply
amien
Helper V
Helper V

Spark SQL data frame using in another Spark SQL dataframe

I have this df

 

df_100 = spark.sql("""SELECT * FROM SOURCE""")
 
But now i want to use this df_100 as source for another df 
 
df_200 = spark.sql("select KEYFIELD from df_100")
 
How can i make this work? I get an error that the table doesn't exist.
If i use this it works:
 
df_100.createOrReplaceTempView("df_100")
df_200 = spark.sql("select KEYFIELD from df_100")
 
it is possible to remove the first step (createOrReplaceTempView) or is there a better way to do this?
 
1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

Helpful resources

Announcements
Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.