Forum Discussion
set concurrency=1 for all pipelines
Hi,
Few questions related to pipeline concurrency:
- Is there an option to set "concurrency": 1 for all pipelines in a workspace via API perhaps?
- Does anyone has a script for that?
- Is there an option to set "concurrency": 1 by default for all new pipelines within a workspace?
Thank you,
Yevgeny
Hi YevgenyM,
To my knoweldge there's no way to set this by default.
What you can do is use the REST APIs to do this programatically. I don't have a script for you, but this would be the general approach:
1: get a pipeline definition: Items - Get Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn2: decode the payload so it is readable
3: edit the readable payload to set the concurrency
4: re-encode the payload,
5: update the pipeline definition: Items - Update Data Pipeline Definition - REST API (DataPipeline) | Microsoft LearnIt helped me solve the issue, but the it is not a complete solution.
A complete solution would include a script - I built a script that did it.
5 Replies
- tayloramy
Super User
Hi YevgenyM,
To my knoweldge there's no way to set this by default.
What you can do is use the REST APIs to do this programatically. I don't have a script for you, but this would be the general approach:
1: get a pipeline definition: Items - Get Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn2: decode the payload so it is readable
3: edit the readable payload to set the concurrency
4: re-encode the payload,
5: update the pipeline definition: Items - Update Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn - v-hashadapu
Community Support
- YevgenyM
Advocate IV
It helped me solve the issue, but the it is not a complete solution.
A complete solution would include a script - I built a script that did it.- v-hashadapu
Community Support
Hi YevgenyM , Thanks for the update. We are very happy to know that your issue is solved. Can you please share the solution here, as it may help others with similar issues understand it. If you have any other queries, please feel free to create a new post here in the community. We are always happy to help.