Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Configuring queue in Fabric

Hi all! Does anyone know how the queue works for spark jobs in Fabric?   I have a F2 capacity, with 4 Spark VCores and at maximum 20 VCores with bursting factor. According to the documentation, I ...
capacities
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Anonymous ,

    Response from Internal Team -

    " The queuing is not enabled yet in the pipeline. When enabled, the jobs will queue instead of failing (current behavior). The support for queueing notebook jobs is still in development and once enabled - notebook jobs triggered from pipelines and schedulers will be queued and automatically retried when cores become available. Currently we don't have any ETA, but we can expect this feature in upcoming releases. "

    Hope this is helpful. Please let me know incase of further queries.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Anonymous ,

Response from Internal Team -

" The queuing is not enabled yet in the pipeline. When enabled, the jobs will queue instead of failing (current behavior). The support for queueing notebook jobs is still in development and once enabled - notebook jobs triggered from pipelines and schedulers will be queued and automatically retried when cores become available. Currently we don't have any ETA, but we can expect this feature in upcoming releases. "

Hope this is helpful. Please let me know incase of further queries.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Thanks Anonymous,

looking forward to see the feature in Fabric soon!

 

Greetings,

Georg

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Anonymous ,

    Glad to know that your query got resolved. Please continue using Fabric Community for your further queries.