Forum Discussion
Advocate IVHow to choose optimal spark environment settings?
Advocate IVThanks AndyDDC , really appreciate it! I'll check it out and see if it helps!
Microsoft - would be awesome if I could run a query in a notebook, and then have CoPilot suggest optimal settings to make it run quickly....
Thanks,
Scott
Community ChampionThere is something called Autotune in preview.
I must be honest, I haven't tested it. I haven't even read about it. I just heard the name. Perhaps it is relevant for what you're asking for: https://learn.microsoft.com/en-us/fabric/data-engineering/autotune?tabs=sparksql
- Scott_Powell
hi frithjof_v , I had heard about the autotune back at the Fabric conference in Vegas, but didn't realize it was actually available yet, and that it was disabled by default. I'll definitely turn this on and see what happens, and post back.
Thanks for the heads up!
Scott
- frithjof_v
Here's a Fabric Espresso video on the Autotune feature:
https://youtu.be/iv1kAz_ShEo?si=arP4FA7wYhJisnvc
Unfortunately, I haven't had the time to watch it myself yet.