Best Practices for Fabric Spark

Learn about the new features releasing from Microsoft fabric using the Spark engine.

Two amazing Microsoft Employees are joining us today to speak about Spark.

Follow Santhosh: https://www.linkedin.com/in/thisissanthoshr/

Follow A**bleep**: https://www.linkedin.com/in/a**bleep**-gosalia/

Follow Mike: https://www.linkedin.com/in/michaelcarlo/

 

Autotuning for spark https://learn.microsoft.com/fabric/data-engineering/autotune?WT.mc_id=DP-MVP-5002621

Native Execution Engine https://learn.microsoft.com/fabric/data-engineering/native-execution-engine-overview?WT.mc_id=DP-MVP-5002621

Learn about Velox https://engineering.fb.com/2023/03/09/open-source/velox-open-source-execution-engine/

Learn about Apache Gluten https://gluten.apache.org/

High concurrency mode for Fabric Spark https://blog.fabric.microsoft.com/en-us/blog/introducing-high-concurrency-mode-for-notebooks-in-pipelines-for-fabric-spark?WT.mc_id=DP-MVP-5002621#podcast

 

 

watch?v=smrNojrTkZA