Forum Discussion
Super UserHigh Concurrency session in Data pipeline
Took 7 notebooks here , attached to same lakehouse ,env and present in same workspace.
In my case it should ideally create2 sessions 1 session (for 5 notebooks) another for ( 2 notebooks) according to the document.
https://learn.microsoft.com/en-us/fabric/data-engineering/configure-high-concurrency-session-notebooks-in-pipelines
But in my case it has created 4 sessions (1 for 4 notebooks , 1 session for remaining 3 notebooks). which is strange. But grouping and reducing time in execution is working as expected.
Resolver IIIAdding on this, the number of parallel sessions is contrained by what can be achieved with the capacity in place. When running a small capacity (F2 or F4), it is possible that only one HC concurrency session will be started at the same time while all other notebooks are being queued until the first session resolves.