Forum Discussion

ati_puri's avatar
ati_puri
Icon for Resolver III rankResolver III
1 year ago
Solved

Can we run Data Pipelines with Workspace Identity?

Hi Team,   We are looking for a solution to run our data pipelines(triggers and schedules) in our production environment using Workspace Identity. We can use Service Principal to do so, but we need...
data engineering
  • ati_puri's avatar
    ati_puri
    1 year ago

    After all the analysis, it is concluded that for running data pipelines in production:

    1) Usage of Service Principal is the ideal solution.

    2) Workspace identity is only used for authenticating to Azure resources securely with Fabric.

    3) Managed Identity is currently not supported to run data pipelines in Fabric.

     

    Thanks

    Ati Puri

ati_puri's avatar
ati_puri
Icon for Resolver III rankResolver III
1 year ago

This seems to be working for authentication purposes only, is there a way to run our deployment pipelines as well with WS identity?

Srisakthi's avatar
Srisakthi
Icon for Super User rankSuper User
1 year ago

Hi ati_puri ,

 

From Azure Devops we can trigger Fabric Deploment Pipelines using Rest APIs. Service Connection in Azure Devops do support using ManagedIdentity. But I havent tested for Fabric Data pipelines or Deployment Pipelines with MI.

Step 1: Create Service Connection with MI

Step 2: Check if you can add MI to your workspace and Deployment Pipleine

Step 3: Create Build pipeline and deploy

 

Just a thought as it works for Azure deployments.

Regards,

Sri

  • v-aatheeque's avatar
    v-aatheeque
    Icon for Community Support rankCommunity Support
    1 year ago

    Hi ati_puri ,

    Just checking in Srisakthi nilendraFabric has shared a response to your query regarding running data pipelines using Workspace Identity in the production environment.

    If the provided solution helped, please consider marking it as Accepted Answer, as it may also benefit others facing a similar challenge. If you're still looking for more clarity or facing issues, feel free to share more details — we’re happy to assist further.

     

    Thank you for being part of the Microsoft Fabric Community!

  • ati_puri's avatar
    ati_puri
    Icon for Resolver III rankResolver III
    1 year ago

    Hi Srisakthi - Managed Identity is not yet supported with Azure Devops to trigger data pipelines.

    • v-aatheeque's avatar
      v-aatheeque
      Icon for Community Support rankCommunity Support
      1 year ago

      Hi ati_puri ,

      • You're correct ,Managed Identity is not yet supported for triggering Microsoft Fabric Data Pipelines directly from Azure DevOps.
      • Managed Identity is typically used to allow Azure services like Azure DevOps, Logic Apps, and others to securely authenticate to Azure resources without needing to manage secrets or credentials. However, this capability is currently unavailable for Microsoft Fabric integration with Azure DevOps.

      References : https://devblogs.microsoft.com/devops/introducing-service-principal-and-managed-identity-support-on-azure-devops/

       

      Hope this Helps!!

      If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

      If you continue to face issues, feel free to reach out to us for further assistance!