Dataflows Gen2 - Variable Library - Service Principal (SPN) support

[frithjof_v]

Currently, Dataflows that use Variable Library integration can only successfully refresh if the refresh is not using an SPN for authentication.

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-variable-library-integration#con...

We need the ability to use SPN for authentication.

[miguel]

Hi! is the ask here to support SPN for the run / refresh of a Dataflow? or to support SPN for anything related to variable libraries?

[frithjof_v]

The Dataflow Gen2 Variable Library documentation lists a limitation: Dataflows can only refresh successfully if the refresh is not authenticated using a Service Principal (SPN).

This idea proposes lifting that limitation. The documentation states this constraint here:

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-variable-library-integration#con...

More broadly, there is a need to deploy, run, and authenticate Dataflow Gen2 using Service Principals or Workspace Identities, without relying on an Organizational (user) account.

In practice, this means enabling Dataflow Gen2 to run in Test and Production environments entirely without a user account, using only non-interactive identities.

[miguel]

Apologies for the confusion. The limitation is actually inherited by the Dataflow itself and not imposed by the Variable library integration with Dataflows.

This documentation article lists the limitation on how you cannot use an SPN to trigger a refresh at this moment:

Background Jobs - Run On Demand Execute - REST API (Dataflow) | Microsoft Learn

We're working towards a plan to faciliate the SPN refresh, but don't have an ETA for it.

Will be declining this idea based on how its framed, as this is not a limitation imposed by the variable libraries, but we can continue the conversation about having dataflows support SPN on the idea below:

Run Dataflow Gen2 as Service Principal - Microsoft Fabric Community