Forum Discussion
Issue with using the external call activity more than once in the same data flow
- Anonymous1 year ago
Hi UmairSyed ,
Here are my personal thoughts on your question:
1. Each workspace has a limit on concurrent pipeline runs and activities. If you're hitting these limits, it could cause timeouts.
2. The external endpoints you're calling might have rate limits that restrict the number of requests you can make in a given time period. If you're making multiple calls in quick succession, you might be exceeding these limits.
3. If your data flow processes a large number of rows, each triggering an external call, it can lead to performance issues and timeouts.To mitigate these issues, you might consider:
1. Instead of making an external call for each row, batch your requests to reduce the number of API calls.
2. Adjust the timeout settings for your activities to allow more time for the external calls to complete.3. You can read this document for a further study:
Data Factory limitations overview - Microsoft Fabric | Microsoft Learn
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi UmairSyed ,
Here are my personal thoughts on your question:
1. Each workspace has a limit on concurrent pipeline runs and activities. If you're hitting these limits, it could cause timeouts.
2. The external endpoints you're calling might have rate limits that restrict the number of requests you can make in a given time period. If you're making multiple calls in quick succession, you might be exceeding these limits.
3. If your data flow processes a large number of rows, each triggering an external call, it can lead to performance issues and timeouts.
To mitigate these issues, you might consider:
1. Instead of making an external call for each row, batch your requests to reduce the number of API calls.
2. Adjust the timeout settings for your activities to allow more time for the external calls to complete.
3. You can read this document for a further study:
Data Factory limitations overview - Microsoft Fabric | Microsoft Learn
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.