topic Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine in Pipelines

TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

jankuc — Wed, 09 Apr 2025 08:25:26 GMT

In Fabric, our orchestration Data pipeline (DP) has an Invoke Pipline Activity that calls another pipeline with some ingestions and other tasks.

So we have orchestration DP that call Ingestion DP. It runs daily and the ingestion DP takes about 90 minutes.

What happens about once a week is that the Ingestion DP finishes successfuly, but the Invoke Activity in the Orchestration DP is marked as Failed with error: TokenExpired with message "Access token has expired, resubmit with a new access token".

What might be the issue and how to work around it? To me it seems that setting multiple retries is not the solution, because then we would run the Ingest DP 2 times.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Wed, 09 Apr 2025 11:19:56 GMT

This exact issue has just occured for me too. Started last night. Same scenario; data pipeline uses the invoke pipeline activty to run another pipeline which takes 90 minutes to run. The invoked pipeline is successful , but the initial pipeline's "Invoke Pipeline" activity fails with the message below.

{"requestId":"xxxx","errorCode":"TokenExpired","message":"Access token has expired, resubmit with a new access token"}

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

jankuc — Wed, 09 Apr 2025 12:51:20 GMT

I think there might be an error. When DF is polling for the status of the invoked pipeline, they are signing it with a token that expires (lets say after 60minutes) and after that, they dont get the memo that the invoked ppln finished successfuly, but get an error with forbidden access, or some such.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Wed, 09 Apr 2025 13:01:30 GMT

Yes I fully agree. I've raised a MS Support ticket. If I get a resolution I'll let you know.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Wed, 09 Apr 2025 14:23:05 GMT

Respnse from Microsoft: "We already have a known issue reported for the similar issue, our Product Team is investigating the issue and I'll let you know when the fix is deployed."

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

jankuc — Wed, 09 Apr 2025 14:33:17 GMT

Wow, you have much faster MS Support than we do. I've filed it even before posting here.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

V-yubandi-msft — Thu, 10 Apr 2025 09:03:05 GMT

Hi jankuc ,

Thank you for the update. Once you receive further information from support, kindly share it here. It will be helpful for others in the community who may be facing similar issues.

Regards,

Yugandhar.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Thu, 10 Apr 2025 09:43:16 GMT

Response from Microsoft Support:

PG team has identified the cause, this issue is linked to the use of OAuth connections for pipelines, resulting in expired access tokens that require resubmission with new tokens. The bug work item is already deployed. It should get fixed by the end of this month.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

jankuc — Thu, 10 Apr 2025 09:54:47 GMT

Thanks for info. We already have a workaround. A notebook that runs if the InvokeActivity fails which gets the status of the pipeline run through rest api. Looking forward to not needing to use that workaround in the future.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

kevingauv — Fri, 11 Apr 2025 14:05:25 GMT

Same problem here.

Microsoft , one month for the expected resolution... it's quite long!

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

echaintreau — Wed, 23 Apr 2025 05:38:04 GMT

Same problem here, let's hope it will be fix at the end of this month.
The workaround needing to deploy a notebook that check pipeline or notebook status through the API seem not ideal solution.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

jankuc — Tue, 22 Apr 2025 11:19:40 GMT

Do you still see these issues today? For us it seems MS has finally deployed some fix and the Invokes don't fail for us.

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Tue, 22 Apr 2025 11:23:26 GMT

That is good news jankuc. I was contacted by Microsoft yesterday to ask if I was still seeing the issue. I responded with this timeline of failures. So hopfully they applied a fix yesterday or today and I'll stop seeing failures moving forward.

09/04/2025 – Fail - Access token has expired, resubmit with a new access token

11/04/2025 – Success

12/04/2025 – Success

13/04/2025 – Success

14/04/2025 – Fail - Access token has expired, resubmit with a new access token

15/04/2025 – Fail - Access token has expired, resubmit with a new access token

16/04/2025 – Fail - Access token has expired, resubmit with a new access token

17/04/2025 – Success

18/04/2025 – Success

19/04/2025 – Fail - Access token has expired, resubmit with a new access token

20/04/2025 – Fail - Access token has expired, resubmit with a new access token

21/04/2025 – Fail – Other Unrelated Issue.

22/04/2025 – Success

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

Jon_Murphy1 — Fri, 25 Apr 2025 09:43:23 GMT

I continued to have the same issue , but with an internal error message instead of the Access Token Expired Message. It was escalated to the product team and as of last night it appear to now be working correctly.

Message from Support below:

Re: TokenExpired Error Fails Invoke pipeline activity even when underlying pipeline finishes fine

ananthkrishna99 — Tue, 17 Mar 2026 17:28:33 GMT

We are facing the same issue again. the Pipeline Copy acitvity is failing after ~90mins of execution while writing data into Lakehouse. It is throwing Lakehouse operation failed for: Operation returned an invalid status code 'Unauthorized'.