Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Learn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now

Reply
amien
Helper V
Helper V

Spark SQL data frame using in another Spark SQL dataframe

I have this df

 

df_100 = spark.sql("""SELECT * FROM SOURCE""")
 
But now i want to use this df_100 as source for another df 
 
df_200 = spark.sql("select KEYFIELD from df_100")
 
How can i make this work? I get an error that the table doesn't exist.
If i use this it works:
 
df_100.createOrReplaceTempView("df_100")
df_200 = spark.sql("select KEYFIELD from df_100")
 
it is possible to remove the first step (createOrReplaceTempView) or is there a better way to do this?
 
1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

February Power BI Update Carousel

Power BI Monthly Update - February 2026

Check out the February 2026 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.