Dataflow Gen2 (CI/CD, preview) - trigger from Notebook?

[dzav]

Since orchestrating a Dataflow Gen2 (CI/CD, preview) inside a pipeline isn't supported is there any other way to trigger these outside of a scheduled run? I tried asking Copilot in a Notebook, but it was hallucinating so badly it didn't think Dataflows were even a feature in Fabric. Any insight into when Microsoft plans on adding the feature that will allow us to trigger them from pipelines?

[nilendraFabric · Accepted solution]

Hello @dzav 

while direct triggering of Dataflow Gen2 from pipelines is not yet available, upcoming features like REST APIs, Power Automate actions, and event-based triggers will likely fill this gap soon

Microsoft has indicated plans to introduce CRUDLE APIs for Dataflow Gen2 items as part of its roadmap. These APIs would allow users to programmatically trigger and manage dataflows, providing a more dynamic way to initiate runs

Dataflow Gen2 CI/CD and Public APIs support

Estimated release timeline: Q1 2025

Release Type: General availability

Dataflow Gen2 items will support CI/CD capabilities in Fabric, including source control (Git integration) as well as ALM Deployment Pipelines. Additionally, customers will be able to programmatically interact with Dataflow Gen2 items in Fabric via the Fabric REST APIs, providing support for CRUDLE operations over Dataflow Gen2 items.

if this helps please accept the answer