set concurrency=1 for all pipelines

[YevgenyM]

Hi,

Few questions related to pipeline concurrency:

1. Is there an option to set "concurrency": 1 for all pipelines in a workspace via API perhaps?
   • Does anyone has a script for that?
2. Is there an option to set "concurrency": 1 by default for all new pipelines within a workspace?
   

Thank you,

Yevgeny

[tayloramy · Accepted solution]

Hi @YevgenyM, 

To my knoweldge there's no way to set this by default. 

What you can do is use the REST APIs to do this programatically. I don't have a script for you, but this would be the general approach: 

1:  get a pipeline definition: Items - Get Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn

2:  decode the payload so it is readable 
3: edit the readable payload to set the concurrency
4: re-encode the payload, 
5: update the pipeline definition: Items - Update Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn

[v-hashadapu]

Hi @YevgenyM , Thank you for reaching out to the Microsoft Community Forum.

We find the answer shared by @tayloramy  is appropriate. Can you please confirm if the solution worked for you. It will help others with similar issues find the answer easily.

Thank you @tayloramy  for your valuable response.

[YevgenyM · Accepted solution]

It helped me solve the issue, but the it is not a complete solution.
A complete solution would include a script - I built a script that did it.

[v-hashadapu]

Hi @YevgenyM , Thanks for the update. We are very happy to know that your issue is solved. Can you please share the solution here, as it may help others with similar issues understand it. If you have any other queries, please feel free to create a new post here in the community. We are always happy to help.

[tayloramy · Accepted solution]

Hi @YevgenyM, 

To my knoweldge there's no way to set this by default. 

What you can do is use the REST APIs to do this programatically. I don't have a script for you, but this would be the general approach: 

1:  get a pipeline definition: Items - Get Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn

2:  decode the payload so it is readable 
3: edit the readable payload to set the concurrency
4: re-encode the payload, 
5: update the pipeline definition: Items - Update Data Pipeline Definition - REST API (DataPipeline) | Microsoft Learn