Fabric dbt Job (preview) Orchestration & REST API

[ameeuw]

Hi, 

I am trying out the new dbt job (preview) item, with the goal to implement it across our data platform as one of the default methods of doing data transformation. To do that, I need to be able to run a dbt job from a Data Pipeline, to make it fit with the rest of our orchestration framework. While there currently is no "Run dbt job" Activity in Data Pipeline, I was expecting at least a REST API to be able to start a dbt job. I cannot find any in the documentation though, is such a thing available? Static time-based scheduling through the regular Job Scheduler is not sufficient for our goals. 

If this is not available, is there any other option for starting a dbt job programmatically? Some notebook/CLI call somewhere maybe? 

Kind regards,

Alexander

[v-hjannapu · Accepted solution]

Hi @ameeuw,
Thank you  for reaching out to the Microsoft fabric community forum.

Right now, dbt jobs in Fabric (preview) can be run only using the built-in schedule option. There is no option yet to trigger a dbt job from a Data Pipeline, and there is also no REST API or supported way to start it programmatically.

Because of this, dbt jobs cannot be linked with pipeline flow or triggered based on other activities. Running dbt through notebook or CLI is also not supported at the moment.

Since this feature is still in preview, these capabilities may be added later. Your requirement makes sense, and similar feedback has already been shared with the product team.

For now, time-based scheduling is the only supported approach. Please keep an eye on future Fabric updates for any changes.

Hope the above provided information help you resolve the issue, if you have any further concerns or queries, please feel free to reach out to us.
Regards,
Community Support Team.