Ivan88's avatar
Ivan88
New Member
8 months ago
Status:
New

Spark high concurrency session sharing between different users

Currently high concurrency session is available only under strict rules. 
as of now:

Session sharing conditions include:

  • Sessions should be within a single user boundary.
  • Sessions should have the same default lakehouse configuration.
  • Sessions should have the same Spark compute properties.


If we could reuse high concurrency session between multiple users, that would improve usability in big teams where a lot of people run may small task at the same time. All other conditions can be met.

Recent ideas