Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us at the 2025 Microsoft Fabric Community Conference. March 31 - April 2, Las Vegas, Nevada. Use code FABINSIDER for $400 discount. Register now

Reply
shiva_fabric
Frequent Visitor

Dependency and Parallel Processing

i have four pipelines running in 2 streams.
each stream has 2 pipelines running in sequence.
if a pipeline fails then the next pipeline should not get executed.
However, this should not affect the one's running in parallel and they should continue.
Final status of the pipeline should be Failed.

 

1 ACCEPTED SOLUTION

NandanHegde_0-1741261312204.png

A and C run in parallel




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

View solution in original post

7 REPLIES 7
shiva_fabric
Frequent Visitor

Any Dependencies should i consider for this

Above is the dependecy flow wherein the 2 pipelines should be dependant via on Success




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com
ahmetyilmaz
Advocate I
Advocate I

Hi, parallel pipelines within the same pipeline already work without being affected by each other. Even if one of them fails, the other pipelines will work, but the main pipeline will return a failure.

shiva_fabric
Frequent Visitor

im looking for a design , if my above ask is possible or not in ms fabric

shiva_fabric
Frequent Visitor

Master Pipeline:
├── Pipeline A (Runs in parallel)
│ └── Pipeline B (Runs only if A succeeds)
├── Pipeline C (Runs in parallel)
└── Pipeline D (Runs only if C succeeds)

NandanHegde_0-1741261312204.png

A and C run in parallel




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com
NandanHegde
Super User
Super User

please provide a pictorial represent of your ask as that would be much more clearer rather than the above statements. 
meaning when you say if a pipeline fails, is it the pipeline within the stream or the external pipeline etc?




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

FebFBC_Carousel

Fabric Monthly Update - February 2025

Check out the February 2025 Fabric update to learn about new features.

Feb2025 NL Carousel

Fabric Community Update - February 2025

Find out what's new and trending in the Fabric community.