Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Dependency and Parallel Processing

i have four pipelines running in 2 streams.
each stream has 2 pipelines running in sequence.
if a pipeline fails then the next pipeline should not get executed.
However, this should not affect the one's running in parallel and they should continue.
Final status of the pipeline should be Failed.

 

7 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Master Pipeline:
    ├── Pipeline A (Runs in parallel)
    │ └── Pipeline B (Runs only if A succeeds)
    ├── Pipeline C (Runs in parallel)
    └── Pipeline D (Runs only if C succeeds)

  • Anonymous's avatar
    Anonymous
    Not applicable

    im looking for a design , if my above ask is possible or not in ms fabric

  • Hi, parallel pipelines within the same pipeline already work without being affected by each other. Even if one of them fails, the other pipelines will work, but the main pipeline will return a failure.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Any Dependencies should i consider for this

    • NandanHegde's avatar
      NandanHegde
      Super User

      Above is the dependecy flow wherein the 2 pipelines should be dependant via on Success

  • please provide a pictorial represent of your ask as that would be much more clearer rather than the above statements. 
    meaning when you say if a pipeline fails, is it the pipeline within the stream or the external pipeline etc?