topic Re: Can we run Data Pipelines with Workspace Identity? in Data Engineering

Can we run Data Pipelines with Workspace Identity?

ati_puri — Wed, 28 May 2025 16:00:31 GMT

Hi Team,

We are looking for a solution to run our data pipelines(triggers and schedules) in our production environment using Workspace Identity. We can use Service Principal to do so, but we need a soltuion with WS Identity. Please let us know if anyone has tried it.

Thanks!

Re: Can we run Data Pipelines with Workspace Identity?

nilendraFabric — Wed, 28 May 2025 20:31:44 GMT

Hi ati_puri

I have tried it and worked. Here is the very detailed tutorial

https://pl.seequality.net/microsoft-fabric-using-workspace-identity-for-authentication/

Re: Can we run Data Pipelines with Workspace Identity?

v-aatheeque — Mon, 02 Jun 2025 18:12:28 GMT

Hi ati_puri ,

If the information is helpful, please accept the answer by clicking the "Upvote" and "Accept Answer" on the post. If you are still facing any issue, please let us know in the comments. We are glad to help you.

We value your feedback, and it will help us to assist others who might have a similar query. Thank you for your contribution in enhancing Microsoft Fabric Community Forum.

Re: Can we run Data Pipelines with Workspace Identity?

ati_puri — Tue, 03 Jun 2025 06:09:19 GMT

This seems to be working for authentication purposes only, is there a way to run our deployment pipelines as well with WS identity?

Re: Can we run Data Pipelines with Workspace Identity?

v-aatheeque — Tue, 03 Jun 2025 12:00:17 GMT

Hi ati_puri ,

For a comprehensive understanding of workspace identity in Microsoft Fabric, I recommend the official article titled "Workspace identity - Microsoft Fabric" available as below.
https://learn.microsoft.com/en-us/fabric/security/workspace-identity

Additionally, the blog "Microsoft Fabric: Using Workspace Identity for Authentication" provides practical insights into its application.

Hope this helps !!

If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

If you continue to face issues, feel free to reach out to us for further assistance!

Re: Can we run Data Pipelines with Workspace Identity?

Srisakthi — Wed, 04 Jun 2025 11:15:49 GMT

Hi ati_puri ,

From Azure Devops we can trigger Fabric Deploment Pipelines using Rest APIs. Service Connection in Azure Devops do support using ManagedIdentity. But I havent tested for Fabric Data pipelines or Deployment Pipelines with MI.

Step 1: Create Service Connection with MI

Step 2: Check if you can add MI to your workspace and Deployment Pipleine

Step 3: Create Build pipeline and deploy

Just a thought as it works for Azure deployments.

Regards,

Sri

Re: Can we run Data Pipelines with Workspace Identity?

v-aatheeque — Thu, 05 Jun 2025 23:15:57 GMT

Hi ati_puri ,

Just checking in Srisakthi nilendraFabric has shared a response to your query regarding running data pipelines using Workspace Identity in the production environment.

If the provided solution helped, please consider marking it as Accepted Answer, as it may also benefit others facing a similar challenge. If you're still looking for more clarity or facing issues, feel free to share more details — we’re happy to assist further.

Thank you for being part of the Microsoft Fabric Community!

Re: Can we run Data Pipelines with Workspace Identity?

ati_puri — Fri, 06 Jun 2025 14:18:42 GMT

Hi Srisakthi - Managed Identity is not yet supported with Azure Devops to trigger data pipelines.

Re: Can we run Data Pipelines with Workspace Identity?

ati_puri — Fri, 06 Jun 2025 14:23:07 GMT

Hi nilendraFabric , Workspace Identity is used only for authentication, can we use in Azure Devops to trigger data pipelines in production? like we do usign User Identity or Service Principal?

Re: Can we run Data Pipelines with Workspace Identity?

v-aatheeque — Mon, 09 Jun 2025 17:15:53 GMT

Hi ati_puri ,

You're correct ,Managed Identity is not yet supported for triggering Microsoft Fabric Data Pipelines directly from Azure DevOps.
Managed Identity is typically used to allow Azure services like Azure DevOps, Logic Apps, and others to securely authenticate to Azure resources without needing to manage secrets or credentials. However, this capability is currently unavailable for Microsoft Fabric integration with Azure DevOps.

References : https://devblogs.microsoft.com/devops/introducing-service-principal-and-managed-identity-support-on-azure-devops/

Hope this Helps!!

If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

If you continue to face issues, feel free to reach out to us for further assistance!

Re: Can we run Data Pipelines with Workspace Identity?

ati_puri — Wed, 11 Jun 2025 07:06:17 GMT

After all the analysis, it is concluded that for running data pipelines in production:

1) Usage of Service Principal is the ideal solution.

2) Workspace identity is only used for authenticating to Azure resources securely with Fabric.

3) Managed Identity is currently not supported to run data pipelines in Fabric.

Thanks

Ati Puri

Re: Can we run Data Pipelines with Workspace Identity?

v-aatheeque — Wed, 11 Jun 2025 09:59:12 GMT

Hi ati_puri ,

Thank you for your insightful analysis and contributions regarding the use of Service Principal and Managed Identity for running data pipelines in Microsoft Fabric.

Your clear understanding of the current limitations and ideal solutions is greatly appreciated. We also value the effort you've taken to explore and document your findings ,it’s incredibly helpful for others in the community who might encounter similar scenarios.

If any of the earlier responses addressed your concerns, feel free to mark it as the Accepted Answer — this helps close the loop and guides others who may have the same question.

Thanks again for being an active part of the Microsoft Fabric Community!