dzebrowitz
1 year agoAdvocate I
Status:
Planned
Invoke Pipeline Task - Workspace Identity Authentication
Currently, the Fabric Data Factory Invoke Pipeline task uses the user's credentials who saved the pipeline to then authenticate to the Azure Data Factory to execute the ADF pipeline. When that user's password is modified, the token expires and the Fabric Data Factory pipeline must be modified and saved for the Invoke Pipeline tasks to begin working again.
I would like to suggest that there be an option in the Invoke Pipeline Task to use the Fabric Workspace Identity, or specify a Service Principal for authentication to ADF.
Without this change, production Data Factory Pipelines will fail to execute after the owner changes their password.
4 Comments
- PauliusBaRegular Visitor
We face the same problem. Our use case: multiple workspaces, each of them orchestrated by their own 'slave' pipelines within those workspaces. Workspaces are interdependent and thus are orchestrated by a 'master' orchestrator pipeline in separate ws. Dependency on SSO makes the solution less reliable and less secure, as pipeline owner's principal must be granted at least CONTRIBUTOR access on all 'slave' workspaces. Workspace Identities could solve this. Furthermore, one would naturally expect workspace identities behaving as OP has mentioned. We are actively looking forward to this improvement. Keep up the good work and thanks!
- MartjanRegular VisitorI see the authentication option Workspace Identity in the connection in the connection manager for both Fabric DataPipelines and Notebooks but get authentication error when using it in the pipeline activity. Is this still unsupported? For Data Pipelines it is documented (preview). For Notebooks is not in the the supported items list in the connection setting dialog box but can be choosen anyway. Please add this as using the workspace permission model in enterprise setups at scale relies on it.
- makromerMicrosoft EmployeeStatus changed:NewtoPlanned
This feature is under development for CY26
- makromerMicrosoft EmployeeStatus changed:PlannedtoPlanned
This is under development for CY26
Recent ideas
Access Variable Library in Semantic Models
Enable the Variable Library as a centralized location for storing all environment‑specific variables, allowing us to adjust them for promotion scenarios (e.g., from dev to prod) without relying on de...FreddyH10 hours agoAdvocate IINew920Views31likes2CommentsEnhance Fabric Pipeline Monitoring with Parent-Child Pipeline Lineage and Parameter Visibility
Currently, Microsoft Fabric Pipeline monitoring lacks several capabilities that are available in Azure Data Factory, making troubleshooting and operational support challenging in enterprise environme...dwramreddy11 hours agoRegular VisitorNew8Views0likes0CommentsDynamic ADLS-Gen2 path input for Spark Jobs Main definition file
I would like the ability to add a dynamic input box on a spark job definition's "Main Definition File" "ADLS-Gen2 path". this would be useful to set base and variable paths across all spark jobs...mfink_db15 hours agoNew MemberNew238Views2likes2CommentsReintroduce Tenant/Capacity Switch to Control "Users can create Plan items" Post-GA
During the Preview phase of Fabric Plan items, administrators had access to a dedicated tenant/capacity setting: "Users can create Plan items". With General Availability (GA), this granular administr...Sri-Surendra_Ku18 hours agoNew MemberNew106Views14likes1Comment