Fabric Runtime provides seamless integration within the Microsoft Fabric ecosystem, delivering a powerful environment for data engineering and data science projects built on Apache Spark.
Fabric Runtime 2.0 is now available in Experimental Public Preview (EPP). This next-generation runtime is purpose-built for large-scale data computations in Microsoft Fabric and introduces key features and components that mark a significant leap forward in enabling scalable analytics and advanced workloads. This screenshot shows how you can switch to Runtime 2.0 EPP at the Workspace settings level. Additionally, you can also switch to Runtime 2.0 EPP at the Environment level.
Core Components and Capabilities
Fabric Runtime 2.0, incorporates the following components and upgrades designed to enhance your data processing capabilities:
- Apache Spark 4.0
- Operating System: Azure Linux 3.0 (Mariner 3.0)
- Java: 21
- Scala: 2.13
- Python: 3.12
- Delta Lake: 4.0
The Fabric Runtime 2.0 experimental preview stage gives you early access to new features and APIs from both Spark 4.0 and Delta Lake 4.0. The preview lets you use the latest Spark-based enhancements right away, ensuring smooth readiness and transition for future changes like the newer Java, Scala, and Python versions.
Explore the full documentation and start using Runtime 2.0 in Fabric today.