Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! It's time to submit your entry. Live now!

Reply
amien
Helper V
Helper V

Spark SQL data frame using in another Spark SQL dataframe

I have this df

 

df_100 = spark.sql("""SELECT * FROM SOURCE""")
 
But now i want to use this df_100 as source for another df 
 
df_200 = spark.sql("select KEYFIELD from df_100")
 
How can i make this work? I get an error that the table doesn't exist.
If i use this it works:
 
df_100.createOrReplaceTempView("df_100")
df_200 = spark.sql("select KEYFIELD from df_100")
 
it is possible to remove the first step (createOrReplaceTempView) or is there a better way to do this?
 
1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

Helpful resources

Announcements
December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.