Dataflows Gen2 - Variable Library - Service Principal (SPN) support
Currently, Dataflows that use Variable Library integration can only successfully refresh if the refresh is not using an SPN for authentication.
We need the ability to use SPN for authentication.
3 Comments
- miguelCommunity AdminStatus changed:NewtoNeed Clarification
Hi! is the ask here to support SPN for the run / refresh of a Dataflow? or to support SPN for anything related to variable libraries?
- frithjof_vCommunity Champion
The Dataflow Gen2 Variable Library documentation lists a limitation: Dataflows can only refresh successfully if the refresh is not authenticated using a Service Principal (SPN).
This idea proposes lifting that limitation. The documentation states this constraint here:
More broadly, there is a need to deploy, run, and authenticate Dataflow Gen2 using Service Principals or Workspace Identities, without relying on an Organizational (user) account.
In practice, this means enabling Dataflow Gen2 to run in Test and Production environments entirely without a user account, using only non-interactive identities.
- miguelCommunity AdminStatus changed:Need ClarificationtoAbandoned
Apologies for the confusion. The limitation is actually inherited by the Dataflow itself and not imposed by the Variable library integration with Dataflows.
This documentation article lists the limitation on how you cannot use an SPN to trigger a refresh at this moment:
Background Jobs - Run On Demand Execute - REST API (Dataflow) | Microsoft Learn
We're working towards a plan to faciliate the SPN refresh, but don't have an ETA for it.
Will be declining this idea based on how its framed, as this is not a limitation imposed by the variable libraries, but we can continue the conversation about having dataflows support SPN on the idea below:
Run Dataflow Gen2 as Service Principal - Microsoft Fabric Community
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak18 hours agoNew MemberNew5Views0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak18 hours agoNew MemberNew7Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak18 hours agoNew MemberNew15Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak19 hours agoNew MemberNew5Views0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak19 hours agoNew MemberNew3Views0likes0Comments