Unable to pass Workspace and Dataflow IDs to dataflow activity.

[4019Charan]

Hello EveryOne @Everyone , So I'm trying to use one big orchestration pipeline to trigger different sub pipelines and dataflows according to the parameters provided. So based on the dataflow ID that I provide it should trigger the respective dataflow. But everytime I trigger my pipeline the dataflow fails. I don't understand what's wrong. When I manually hardcord the associated dataflow with the pipeline then it works, but when I try to call the dataflow using the provided variables it fails. Also the dataflow itself runs fine, i checked it by triggering it manually and it worked fine. If some one could help me solve the issue. It'd be really helpful. 

[4019Charan]

Hello jennratten, so you are right I have tried to build with dataflowGen2 with CI/CD. Since I've already built out the solution is there any way that I could turn off the CI/CD to my existing dataflowGen2?

[jennratten · Accepted solution]

Hello @4019Charan  - I tested triggering dataflows Gen2 with and without CICD using dynamic content filled by parameters and variables.  The dataflow Gen2 with CICD failed with both parameters and variables while the dataflow Gen2 without CICD was successful with both parameters and variables.  Are you using dataflow gen2 with CICD?  If so, can you try it with out CICD?  I have included a screenshot below showing the runs and have also attached the data pipeline for you.

[4019Charan]

Thank you @jennratten . so it does work without CICD but not with CICD. I wonder what could be the problem. But thanks for pointing that out. I really appreciate it.