Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
Is it possible to run/refresh a dataflow gen 2 through an api?
I've tried Job Scheduler Api with jobType=dataflowgen2 but with service principal authentication doesn't work.
Is there a workaround?
Hi @nokunta ,
Currently, there is no suitable api to implement dataflow gen2 refresh. But you can realize data refresh by copy data activity in data pipeline, refer to the following api:
PATCH https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/dataPipelines/{dataPipelineId}
You can refer to below document:
Items - Update Data Pipeline - REST API (DataPipeline) | Microsoft Learn
Best Regards,
Adamk Kong
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Ok, my dataflow already appends the data to the destination I didn't want to duplicate this data.
Any idea when pipeline type will work with service principal or when we will have an api ro run/schedule dataflows?
Please vote to highlight the need for service principal authentication in Fabric API:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=e5ec086c-f1ce-ee11-92bd-6045bdbce644
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.