Forum Discussion
Data Pipeline : Invoke Pipeline Issue
Hi Jester_3 ,
The pipeline is failing because the child pipeline is taking longer to complete. To resolve this, I switched to using the Invoke Pipeline (Legacy) activity instead of the Invoke Pipeline (Preview) activity, and the pipeline succeeded.
Please use Invoke Pipeline (Legacy), as the Preview version relies on a linked service, and the access token used by that linked service is expiring during long-running executions.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks & Regards,
Rekha,
CustomerSupportTeam.
Hi Jester_3 ,
Thank you the quick response.
Could you please ensure that the 'Wait on completion' setting is enabled on the Invoke Pipeline activity, and also confirm that all notebooks in the child pipeline complete successfully? From my end, this setup appears to be working correctly.
Additionally, please check which specific activity or step is causing the failure in the parent pipeline. This will help isolate whether the error is coming from the child pipeline or the
invocation logic.
If the notebooks are intermittently failing on the first run and succeeding on retry, consider adding try-catch blocks within the notebooks to gracefully handle transient errors (like token expiration), so they don’t fail on the first attempt
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks & Regards,
Rekha,
CustomerSupportTeam.
Hi v-sathmakuri
Wait on completion is enabled on all invoke-pipeline-activity nodes.
There is no error reported from the child pipeline :
There is an error reported from the initial invoke pipeline in the main pipeline :
This is the message that is displayed for that failure
"message": "Access token has expired, resubmit with a new access token".
I have no idea what access token its referencing.
Hope this helps narrow it down.
Like I said in my initial post i've ahd this set up for some time with no issue so i don't understand why its happening now, logically it shouldn't be.
Hi Jester_3 ,
The pipeline is failing because the child pipeline is taking longer to complete. To resolve this, I switched to using the Invoke Pipeline (Legacy) activity instead of the Invoke Pipeline (Preview) activity, and the pipeline succeeded.
Please use Invoke Pipeline (Legacy), as the Preview version relies on a linked service, and the access token used by that linked service is expiring during long-running executions.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks & Regards,
Rekha,
CustomerSupportTeam.
Hi v-sathmakuri
You were correct it was an issue with using the preview version of invoke-pipeline.
Thanks for your help.