frithjof_v's avatar
frithjof_v
Community Champion
7 months ago
Status:
Abandoned

Dataflows Gen2 - Variable Library - Service Principal (SPN) support

Currently, Dataflows that use Variable Library integration can only successfully refresh if the refresh is not using an SPN for authentication.

 

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-variable-library-integration#considerations-and-limitations

 

We need the ability to use SPN for authentication.

3 Comments

  • miguel's avatar
    miguel
    Community Admin
    Status changed:
    New
    to
    Need Clarification

    Hi! is the ask here to support SPN for the run / refresh of a Dataflow? or to support SPN for anything related to variable libraries?

  • frithjof_v's avatar
    frithjof_v
    Community Champion

    The Dataflow Gen2 Variable Library documentation lists a limitation: Dataflows can only refresh successfully if the refresh is not authenticated using a Service Principal (SPN).

    This idea proposes lifting that limitation. The documentation states this constraint here:

    https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-variable-library-integration#considerations-and-limitations

    More broadly, there is a need to deploy, run, and authenticate Dataflow Gen2 using Service Principals or Workspace Identities, without relying on an Organizational (user) account.

    In practice, this means enabling Dataflow Gen2 to run in Test and Production environments entirely without a user account, using only non-interactive identities.

  • miguel's avatar
    miguel
    Community Admin
    Status changed:
    Need Clarification
    to
    Abandoned

    Apologies for the confusion. The limitation is actually inherited by the Dataflow itself and not imposed by the Variable library integration with Dataflows.

     

    This documentation article lists the limitation on how you cannot use an SPN to trigger a refresh at this moment:

    Background Jobs - Run On Demand Execute - REST API (Dataflow) | Microsoft Learn

     

    We're working towards a plan to faciliate the SPN refresh, but don't have an ETA for it.

     

    Will be declining this idea based on how its framed, as this is not a limitation imposed by the variable libraries, but we can continue the conversation about having dataflows support SPN on the idea below:

    Run Dataflow Gen2 as Service Principal - Microsoft Fabric Community

Recent ideas