Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Vote for your favorite vizzies from the Power BI Dataviz World Championship submissions. Vote now!

Reply
amien
Helper V
Helper V

Spark SQL data frame using in another Spark SQL dataframe

I have this df

 

df_100 = spark.sql("""SELECT * FROM SOURCE""")
 
But now i want to use this df_100 as source for another df 
 
df_200 = spark.sql("select KEYFIELD from df_100")
 
How can i make this work? I get an error that the table doesn't exist.
If i use this it works:
 
df_100.createOrReplaceTempView("df_100")
df_200 = spark.sql("select KEYFIELD from df_100")
 
it is possible to remove the first step (createOrReplaceTempView) or is there a better way to do this?
 
1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

Vote for your favorite vizzies from the Power BI World Championship submissions!

Sticker Challenge 2026 Carousel

Join our Community Sticker Challenge 2026

If you love stickers, then you will definitely want to check out our Community Sticker Challenge!

January Power BI Update Carousel

Power BI Monthly Update - January 2026

Check out the January 2026 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.