topic cannot run t-sql notebook in pipeline in Data Engineering

cannot run t-sql notebook in pipeline

slachmuyldera — Fri, 09 May 2025 16:50:41 GMT

I am trying to create a pipeline that runs a series of t-sql notebooks. The notebooks run fine by themselves, but when I run it from the pipeline I receive this error:

Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - SqlDwException, Error value - DMS workload error in executing code cell: [Internal error MwcTokenValidationException. (ErrorCode=MwcTokenValidationException) (HTTP 401)]. DatamartId: xxxx. Data warehouse trace id: xxxx' :

Others have reported being able to do this activity just fine. Any ideas?

Re: cannot run t-sql notebook in pipeline

QixiaoWang — Mon, 12 May 2025 03:08:50 GMT

suggest to file a support ticket on this. thanks

Re: cannot run t-sql notebook in pipeline

v-karpurapud — Mon, 12 May 2025 07:08:26 GMT

Hi @slachmuyldera

Welcome to the Microsoft Fabric Forum,

The error you are encountering, MwcTokenValidationException (HTTP 401), usually indicates a token validation issue related to authentication or authorization.

When a notebook is triggered through a pipeline in Microsoft Fabric, it uses a system-assigned managed identity or a service principal for authentication. If this identity or principal lacks the necessary permissions on the Datamart or Warehouse, the authentication will fail, even if the notebook runs successfully when executed manually.

Verify the permissions such as the service principal or user account running the pipeline has the appropriate read and write permissions to access the data warehouse.

Additionally, upgrading to the latest stable runtime version can sometimes resolve execution delays or metadata commit inconsistencies.

There is a known issue with the Distributed Query Processor (DQP) on the Microsoft side that could contribute to this behavior.

For further reference, a similar issue has been discussed in the following thread:

Solved: Unable to access Data Warehouse: MwcTokenValidatio... - Microsoft Fabric Community

If this information helps resolve your issue, kindly consider marking this response as the Accepted Solution, as it may assist other community members facing similar challenges.

Thank you for being part of the Microsoft Fabric Community.

Re: cannot run t-sql notebook in pipeline

v-karpurapud — Thu, 15 May 2025 12:34:21 GMT

Hi @slachmuyldera

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

Re: cannot run t-sql notebook in pipeline

v-karpurapud — Mon, 19 May 2025 12:11:53 GMT

Hi @slachmuyldera

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

Re: cannot run t-sql notebook in pipeline

slachmuyldera — Mon, 19 May 2025 22:03:05 GMT

I am in the process of trying to get some response back from support. So, no solution yet.

Re: cannot run t-sql notebook in pipeline

v-karpurapud — Tue, 20 May 2025 04:43:51 GMT

Hi @slachmuyldera

Thank you for the update. If you have found a solution, please share it here, as it will help other community members facing similar issues. Looking forward to your response.

Regards,
Karpurapu D.

Re: cannot run t-sql notebook in pipeline

v-karpurapud — Fri, 30 May 2025 05:51:09 GMT

Hi @slachmuyldera

We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft?

If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. If we don’t hear back, we’ll go ahead and close this thread.

Should you need further assistance in the future, we encourage you to reach out via the Microsoft Fabric Community Forum and create a new thread. We’ll be happy to help.

Thank you for your understanding and participation.