topic Re: Fabric pipeline failing in concurrent runs in Data Engineering

Fabric pipeline failing in concurrent runs

girishtharwani2 — Tue, 17 Jun 2025 13:05:12 GMT

Hi,

I am running fabric pipeline which points to snowflake and when object count is more than 20, the fabric pipeline is failing and not even hitting snowflake.

Can someone please assist.

Thanks,

Girish

Re: Fabric pipeline failing in concurrent runs

Srisakthi — Wed, 18 Jun 2025 05:00:54 GMT

Hi girishtharwani2 ,

Can you check if there is any rules applied at snowflake side. There could be some settings applied at Snowflake side. Like, MAX Concurrency for warehouse, max data size can be fetched .

Regards,

Srisakthi

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Wed, 18 Jun 2025 07:20:53 GMT

Hi girishtharwani2 ,

Thanks for reaching out to the Microsoft fabric community forum.

Srisakthi

Thanks for your prompt response

girishtharwani2 ,

Based the screenshot you shared

It looks like your pipeline is failing due to a request being blocked by the upstream service. Based on the error message in the image you uploaded, the request is blocked until 6/17/2025 at 12:41:52 PM (UTC). This suggests that the issue might be related to rate limiting or a restriction imposed by the upstream service

Below are a few troubleshooting steps to check

Concurrency Limits: Snowflake has concurrency restrictions. If your Fabric pipeline is making too many requests simultaneously, this could trigger a block.
Fabric Configuration: Ensure that your Fabric pipeline settings allow handling more than 20 objects in a batch. If there’s a setting limiting concurrency or object count, try adjusting it.
Retry Strategy: If the request is temporarily blocked, implement a retry mechanism to avoid overwhelming the service.
Check Snowflake Logs: Since your request isn’t even hitting Snowflake, verify if there are any settings preventing Fabric from reaching Snowflake under high load.
Service Limits & Quotas: Review the API/service quotas to ensure you aren’t exceeding limits.

Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn

Solved: Re: Unable to connect to Snowflake from Microsoft ... - Microsoft Fabric Community

Snowflake connector overview - Microsoft Fabric | Microsoft Learn

If this post helped resolve your issue, please consider the Accepted Solution. This not only acknowledges the support provided but also helps other community members find relevant solutions more easily.

We appreciate your engagement and thank you for being an active part of the community.

Best regards,
LakshmiNarayana.

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Wed, 18 Jun 2025 17:04:38 GMT

I’ve tried all the suggested steps, but unfortunately, nothing has worked so far. I’ve set the object count to 40, as it's a business requirement.

Additionally, I'm not using any API in this process.

The retry strategy hasn’t been effective either, since the service typically remains unavailable for over 30 minutes once the error occurs.

Thanks,

Girish

Re: Fabric pipeline failing in concurrent runs

anon97242 — Wed, 18 Jun 2025 21:54:10 GMT

I have had this issue and it seems it is related to capacity size number of vcores. Try reducing concurrency to less than the number Vcores you have in your capacity. 2-3, and see if it resolves the issue. You may also have to wait some time before trying again.

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Thu, 19 Jun 2025 04:51:11 GMT

We use F128 which has sufficient vcores.

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Thu, 19 Jun 2025 04:52:39 GMT

Hi girishtharwani2

Thanks for your prompt response

anon97242 in addiotion to girishtharwani2 Added a learning document which can help you resolve the issue

Concurrency limits and queueing in Apache Spark for Fabric - Microsoft Fabric | Microsoft Learn

(1) Solved: Error code 2108 : Data Factory - Microsoft Fabric Community

If you're still facing challenges, feel free to let us know we’ll be glad to assist you further.

Looking forward to your response.

Best Regards,

Lakshmi Narayana

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Thu, 19 Jun 2025 04:54:17 GMT

There is no such rule built on snowflake.

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Tue, 24 Jun 2025 06:44:23 GMT

Hi girishtharwani2 ,

If your issue has been resolved, please consider marking the most helpful reply as the accepted solution. This helps other community members who may encounter the same issue to find answers more efficiently.

If you're still facing challenges, feel free to let us know we’ll be glad to assist you further.

Looking forward to your response.

Best regards,
LakshmiNarayana.

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Tue, 24 Jun 2025 03:31:31 GMT

Same pipeline with 50 concurrency works in synapse however not in fabric.

Fabric also working on 128 capacity however still failing.

Anything else that I can try ?

Thanks,

Girish

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Tue, 24 Jun 2025 06:59:52 GMT

Hi girishtharwani2 ,

Thanks for the detailed response

You can try the workaround below.

1.Throttle concurrency to 10–20 and gradually scale up. Fabric may not handle 50 concurrent threads the same way Synapse does.

2.Add retry logic and increase timeout settings in the Copy activity or notebook.

3.Split the pipeline into smaller batches using a dynamic ForEach controller.

4. Monitor Spark session logs and capacity metrics in the Fabric Monitoring Hub to identify queuing or memory pressure.

5.Temporarily disable High Concurrency Mode if enabledsome users report it causes failures even when not actively used

Configure high concurrency mode for notebooks in pipelines - Microsoft Fabric | Microsoft Learn

Known issue - Pipelines fail with missing capacity error - Microsoft Fabric | Microsoft Learn

If you're still facing the same issue,
I suggest raising a support ticket so the support team can assist you in resolving the problem.
Please refer to the link below for instructions on how to raise a support ticket:

How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

If this post helped resolve your issue, please consider marking it as the Accepted Solution.
This not only acknowledges the support provided but also helps other community members find relevant solutions more easily.

We appreciate your engagement and thank you for being an active part of the community.

Best regards,
LakshmiNarayana

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Thu, 03 Jul 2025 10:29:12 GMT

Hi girishtharwani2 ,

As we have not received a response, we are proceeding to close this thread for now. If you are still encountering the same issue or have any additional questions, we kindly request you to create a new thread, and we will be more than happy to assist you further.

In accordance with the community guidelines, if you found our response helpful, please consider marking it as Accepted as Solution to help others in the community facing similar issues.

Thank you for your patience, understanding, and continued support.

Best regards,
Lakshmi Narayana

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Thu, 03 Jul 2025 12:03:09 GMT

Issue not yet resolved.

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Thu, 03 Jul 2025 12:03:37 GMT

Can we simply conclude that fabric does not support concurrency more than 25 or so ?

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Fri, 04 Jul 2025 11:49:33 GMT

Hi girishtharwani2 ,

I wanted to follow up on the issue we discussed earlier. As mentioned previously, raising a support ticket could help move things forward and potentially resolve the matter more efficiently.

Could you kindly confirm if the ticket has been raised? If not, I recommend reaching out to the support team soon they may be able to provide valuable assistance.

Please let me know if you need any support in the process.

Best regards,
Lakshmi Narayana

Re: Fabric pipeline failing in concurrent runs

BhaveshPatel — Mon, 07 Jul 2025 08:45:57 GMT

Microsoft Fabric Pipelines has a limit on the number of concurrent jobs that can run. If you exceed this limit, you might see errors like the one you mentioned. A workspace is limited to 1000 concurrent task runs. If this limit is exceeded, you will receive a "Too Many Requests response" message

Re: Fabric pipeline failing in concurrent runs

girishtharwani2 — Mon, 07 Jul 2025 10:00:13 GMT

Thanks for the assistance.

Is there a way we can check number of tasks running in fabric ?

Re: Fabric pipeline failing in concurrent runs

v-lgarikapat — Tue, 29 Jul 2025 07:26:27 GMT

Hi girishtharwani2 ,

you can monitor activity per workload type: Spark jobs in Lakehouse are visible via the Spark Job UI showing executor and task count; notebooks and data pipelines within the workspace indicate status labels like Running or Queued and can be tracked via job history logs; Data Activator visualizes trigger flows; and REST APIs allow querying artifact statuses such as notebooks or pipelines for active runs. Though there’s no global task count endpoint, you can script checks using PowerShell or Python, loop through workspaces, filter by status, and even visualize the results in Power BI for governance and observability

Best Regards,

Lakshmi