Now we can only schedule running of Dataflow Gen2 or Data pipeline on certain time. We need to be able to start Dataflow/Pipeline based on event (for example finish of on-prem data warehouse load).
So we need one of this possibilities:
- REST API to run Dataflow/Pipeline
- or Power Automate action to run Dataflow/Pipeline (like we have action refresh Power BI dataset)
- or some sort of dynamical scheduling based on data (in lakehouse/warehouse)
:
6 Comments
- We are planning file arrival and file delete events to trigger a pipeline post-GA. After that, we will add more event-based triggering mechanisms in Data Factory.
Hi, if you add a Fabric connector for Power Automate as per the Azure Data Factory connector, then that could be used to trigger pipelines and pass parameters from a wide range of events from Azure, Dataverse and others...and also file events
- Status added:Planned
- Hello, Any update about this?
- Gen2 flow runs were supported and now they don't seem to be with the default gen2 CI/CD version. Please update to allow PA to run Gen2 and Pipeline.
- Gen2 flow runs were supported and now they don't seem to be with the default gen2 CI/CD version. Please update to allow PA to run Gen2 and Pipeline.
