Forum Discussion
How to set up a Pipeline that is using Dataflow Gen 2 as a trigger?
- 9 months ago
Hi NovaBI,
Why not make the pipeline drive your run?
Switch it up so that your power automate runs the pipeline instead of the dataflow directly using the HTTP connector.
Have the first activity of the pipeline be to run the dataflow. That ensures that any subsequent activities in the pipeline run after the dataflow is completed.
A Fabric Data pipeline cannot “listen” to a Dataflow Gen2 refresh that happened outside the pipeline and then auto-continue. In other words:
If Dataflow Gen2 is refreshed by Power Automate (or manually), the pipeline won’t auto-trigger off that completion event.
Pipelines currently trigger by manual run / schedule / (some) triggers, but not “on Dataflow Gen2 completion” as an event hook.
If DF1 must be triggered by Power Automate:
Trigger DF1 refresh in Power Automate
Poll/wait until refresh status = Completed (Power Automate often needs a loop checking refresh history/status)
Then:
Start the pipeline, or
Trigger Dataflow 2 refresh directly
Key point: you must explicitly “call the next step”; Fabric pipeline won’t automatically detect DF1 finishing.
First, grab the two IDs you need from Fabric:
workspaceId = the GUID in the workspace URL
itemId = the pipeline item’s GUID (you can usually see it in the item URL / “Copy link”, or retrieve it via Fabric item APIs if needed)
Then in Power Automate:
Create a flow (trigger can be manual, scheduled, or “when Dataflow refresh completes” if you already have that event).
- Compose Ids
Add an action that can call a REST API with Entra ID auth (commonly HTTP with Microsoft Entra ID / a custom connector / or an app registration using client credentials).
This is what I'm building now, just need to wait for the Power Automate Prem License as HTTP Request is a premium feature 🙂