Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Enhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.

lixinche2025

support AI features in Scala

Submitted by Microsoft Employee on ‎04-18-2025 11:05 AM

most of our data processing code was implemented in Scala. This choice was driven by Scala’s native integration with Spark, superior performance, full access to Spark features, strong compile-time safety, and more mature tooling and ecosystem support at the time.

While PySpark has significantly improved—offering near API parity, better performance, and support for the Pandas API—migrating all our existing Scala code to Python might not provide the best user experience and could introduce unnecessary complexity.

 

Could you provide Scala support in AI features?

Status: New
See more ideas labeled with:
Comment