Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
sammydyson555
New Member

Can you write Materialised Lake view from a pyspark view

It seems that the process fails to write data to a tempview in pyspark using  createOrReplaceTempView  and then try to use that as my source to write data to the materialised view, but in spark sql you can still see the data if you select the view

 

Please confirm

1 ACCEPTED SOLUTION
tayloramy
Community Champion
Community Champion

Hi @sammydyson555,

 

No. You can’t create a Materialized Lake View from a PySpark temporary view. createOrReplaceTempView is session-scoped and isn’t registered in the Lakehouse metastore, so the MLV engine can’t “see” it even though a SELECT works inside your Spark session. Create the MLV from physical Delta tables (or a permanent view that resolves to Delta tables) instead. See Microsoft’s overview and quickstart: Overview of Materialized Lake Views, Get started. Community confirmation of the temp-view limitation: this thread.

 

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.

View solution in original post

1 REPLY 1
tayloramy
Community Champion
Community Champion

Hi @sammydyson555,

 

No. You can’t create a Materialized Lake View from a PySpark temporary view. createOrReplaceTempView is session-scoped and isn’t registered in the Lakehouse metastore, so the MLV engine can’t “see” it even though a SELECT works inside your Spark session. Create the MLV from physical Delta tables (or a permanent view that resolves to Delta tables) instead. See Microsoft’s overview and quickstart: Overview of Materialized Lake Views, Get started. Community confirmation of the temp-view limitation: this thread.

 

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

September Fabric Update Carousel

Fabric Monthly Update - September 2025

Check out the September 2025 Fabric update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Kudoed Authors