Dataflows Gen2 - Variable Library - Service Principal (SPN) support
Currently, Dataflows that use Variable Library integration can only successfully refresh if the refresh is not using an SPN for authentication.
We need the ability to use SPN for authentication.
3 Comments
- miguelCommunity AdminStatus changed:NewtoNeed Clarification
Hi! is the ask here to support SPN for the run / refresh of a Dataflow? or to support SPN for anything related to variable libraries?
- frithjof_vCommunity Champion
The Dataflow Gen2 Variable Library documentation lists a limitation: Dataflows can only refresh successfully if the refresh is not authenticated using a Service Principal (SPN).
This idea proposes lifting that limitation. The documentation states this constraint here:
More broadly, there is a need to deploy, run, and authenticate Dataflow Gen2 using Service Principals or Workspace Identities, without relying on an Organizational (user) account.
In practice, this means enabling Dataflow Gen2 to run in Test and Production environments entirely without a user account, using only non-interactive identities.
- miguelCommunity AdminStatus changed:Need ClarificationtoAbandoned
Apologies for the confusion. The limitation is actually inherited by the Dataflow itself and not imposed by the Variable library integration with Dataflows.
This documentation article lists the limitation on how you cannot use an SPN to trigger a refresh at this moment:
Background Jobs - Run On Demand Execute - REST API (Dataflow) | Microsoft Learn
We're working towards a plan to faciliate the SPN refresh, but don't have an ETA for it.
Will be declining this idea based on how its framed, as this is not a limitation imposed by the variable libraries, but we can continue the conversation about having dataflows support SPN on the idea below:
Run Dataflow Gen2 as Service Principal - Microsoft Fabric Community
Recent ideas
Provide a Read-Only / Source-Safe Mode for Schema Shortcuts in Lakehouse
Schema Shortcuts provide a much better management experience than individual Table Shortcuts because they preserve the source schema structure and allow multiple tables to be onboarded at once. Howev...Junghyoen1 hour agoMicrosoft EmployeeNew19Views8likes0CommentsAccess Variable Library in Semantic Models
Enable the Variable Library as a centralized location for storing all environment‑specific variables, allowing us to adjust them for promotion scenarios (e.g., from dev to prod) without relying on de...FreddyH12 hours agoAdvocate IINew920Views31likes2CommentsEnhance Fabric Pipeline Monitoring with Parent-Child Pipeline Lineage and Parameter Visibility
Currently, Microsoft Fabric Pipeline monitoring lacks several capabilities that are available in Azure Data Factory, making troubleshooting and operational support challenging in enterprise environme...dwramreddy13 hours agoRegular VisitorNew8Views0likes0CommentsDynamic ADLS-Gen2 path input for Spark Jobs Main definition file
I would like the ability to add a dynamic input box on a spark job definition's "Main Definition File" "ADLS-Gen2 path". this would be useful to set base and variable paths across all spark jobs...mfink_db17 hours agoNew MemberNew238Views2likes2CommentsReintroduce Tenant/Capacity Switch to Control "Users can create Plan items" Post-GA
During the Preview phase of Fabric Plan items, administrators had access to a dedicated tenant/capacity setting: "Users can create Plan items". With General Availability (GA), this granular administr...Sri-Surendra_Ku20 hours agoNew MemberNew106Views14likes1Comment