Forum Discussion
Which is Spark version supported by Fabric
I never tried the template snippets, but maybe they can be helpful:
https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook#code-snippets
Here are some learning materials and exercise for working with PySpark, Dataframes, Tables:
https://learn.microsoft.com/en-us/training/modules/use-apache-spark-work-files-lakehouse/
https://learn.microsoft.com/en-us/training/modules/work-delta-lake-tables-fabric/
Personally, ChatGPT has helped me solve some code questions regarding PySpark, SparkSQL, etc.
And also Googling for PySpark / Delta Lake questions can provide answers. Many Databricks related PySpark / Delta Lake questions and answers can be relevant also for Fabric.
If you try to create a table in Lakehouse, you may encounter an error 'Please ensure that the workspace is configured with Spark version <= 3.4 (i.e. Fabric runtime version <= 1.2)'
The Spark version compatible with Fabric should be <=3.4 (Fabric runtime version <= 1.2).
To check and modify the Spark version, follow the below steps:
- Go to your Workspace
- Workspace Settings (top right)
- Expand 'Data Engineering/Science' from left pane
- Select 'Spark Settings'
- Go To 'Environments'
- Check 'Runtime Version'
- From the dropdown, select the Runtime Version 1.2
- Save
- Try creating the table again and it should work