Fabric pipeline failing in concurrent runs

[girishtharwani2]

Hi,

I am running fabric pipeline which points to snowflake and when object count is more than 20, the fabric pipeline is failing and not even hitting snowflake.

Can someone please assist.

Thanks,

Girish

[v-lgarikapat]

Hi @girishtharwani2 ,

Thanks for reaching out to the Microsoft fabric community forum.

@Srisakthi 

Thanks for your prompt response

@girishtharwani2 , 

Based the screenshot you shared 

It looks like your pipeline is failing due to a request being blocked by the upstream service. Based on the error message in the image you uploaded, the request is blocked until 6/17/2025 at 12:41:52 PM (UTC). This suggests that the issue might be related to rate limiting or a restriction imposed by the upstream service

    Below are a few troubleshooting steps to check

1. Concurrency Limits: Snowflake has concurrency restrictions. If your Fabric pipeline is making too many requests simultaneously, this could trigger a block.
2. Fabric Configuration: Ensure that your Fabric pipeline settings allow handling more than 20 objects in a batch. If there’s a setting limiting concurrency or object count, try adjusting it.
3. Retry Strategy: If the request is temporarily blocked, implement a retry mechanism to avoid overwhelming the service.
4. Check Snowflake Logs: Since your request isn’t even hitting Snowflake, verify if there are any settings preventing Fabric from reaching Snowflake under high load.
5. Service Limits & Quotas: Review the API/service quotas to ensure you aren’t exceeding limits.

Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn

Solved: Re: Unable to connect to Snowflake from Microsoft ... - Microsoft Fabric Community

Snowflake connector overview - Microsoft Fabric | Microsoft Learn

If this post helped resolve your issue, please consider the Accepted Solution. This not only acknowledges the support provided but also helps other community members find relevant solutions more easily.

We appreciate your engagement and thank you for being an active part of the community.

Best regards,
LakshmiNarayana.

[Srisakthi]

Hi @girishtharwani2 ,

Can you check if there is any rules applied at snowflake side. There could be some settings applied at Snowflake side. Like, MAX Concurrency for warehouse, max data size can be fetched .

Regards,

Srisakthi