Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Enhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.

Reply
amien
Helper V
Helper V

Spark SQL data frame using in another Spark SQL dataframe

I have this df

 

df_100 = spark.sql("""SELECT * FROM SOURCE""")
 
But now i want to use this df_100 as source for another df 
 
df_200 = spark.sql("select KEYFIELD from df_100")
 
How can i make this work? I get an error that the table doesn't exist.
If i use this it works:
 
df_100.createOrReplaceTempView("df_100")
df_200 = spark.sql("select KEYFIELD from df_100")
 
it is possible to remove the first step (createOrReplaceTempView) or is there a better way to do this?
 
1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

df_200 = df_100.select("KEYFIELD")

Helpful resources

Announcements
July PBI25 Carousel

Power BI Monthly Update - July 2025

Check out the July 2025 Power BI update to learn about new features.

Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.