Users within the same workspace can utilize the same launched Spark Cluster. This eliminates the need for users to wait for the startup time of Spark, and also prevents excessive CU consumption caus...
psanchezalvial
Advocate I
Advocate IHigh concurrency is useful. But It would be better an approach like Databricks when you can start a cluster on their own instead of start it from a job or from a notebook.
Recent ideas
Support Automatic Connection Variable Mapping for Lakehouse Shortcuts Across Deployment Pipelines
When using Deployment Pipelines to promote Lakehouses containing shortcuts that use Delegated Identity, the connection variables defined through a Variable Library are not consistently retained or au...
