Forum Discussion
Which is Spark version supported by Fabric
I never tried the template snippets, but maybe they can be helpful:
https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook#code-snippets
Here are some learning materials and exercise for working with PySpark, Dataframes, Tables:
https://learn.microsoft.com/en-us/training/modules/use-apache-spark-work-files-lakehouse/
https://learn.microsoft.com/en-us/training/modules/work-delta-lake-tables-fabric/
Personally, ChatGPT has helped me solve some code questions regarding PySpark, SparkSQL, etc.
And also Googling for PySpark / Delta Lake questions can provide answers. Many Databricks related PySpark / Delta Lake questions and answers can be relevant also for Fabric.
Hi pmscorca ,
Thanks for the reply from frithjof_v .
By default, all new workspaces use the latest runtime version, currently Runtime 1.2.
For more information on Runtime 1.2, please see:
Runtime 1.2 in Fabric - Microsoft Fabric | Microsoft Learn
Deep Dive into Apache Spark-based Runtime 1.2 Available in the Fabric.
Take a deeper dive into Apache Spark-based Runtime 1.2 in the fabric and learn about its unique features, functionality, and best practices.
Microsoft Fabric Runtime 1.2 is the latest version of the GA runtime.The key components of Runtime 1.2 include
- Apache Spark 3.4.1
- Operating System: Mariner 2.0
- Java: 11
- Scala: 2.12.17
- Python 3.10
- Delta Lake: 2.4.0
- R: 4.2.2
Best Regards,
Yang
Community Support Team
If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!