Forum Discussion
Solved
Using Airflow and DBT Core in Fabric
We have data in the raw layer and want to transform it using DBT core. Right now we are using DBT on vscode and able work on fabric. When it comes to orchestration I am having some doubts. I am going...
You can use notebook to execute your dbt :
https://www.proserveit.com/blog/run-dbt-with-dbt-fabric-adapter-in-fabric-notebook
nilendraFabric
Super User
Super UserHello sreedharshan_10
I am not able to find particular resources , but here is the summary which will help team to decide which tool to use.
In simple terms , if your current workflow with dbt on VSCode meets your transformation needs and your team has the technical proficiency to manage more complex, code-driven pipelines, Apache Airflow would be an efficient choice. However, if you prefer tight integration with other Azure services and require a less hands-on orchestration tool, then Azure Data Factory might be the better choice.
| Feature | Apache Airflow | Azure Data Factory |
| Flexibility | High (custom DAGs, detailed dependency management) | Moderate (visual design, less granular control) |
| dbt Integration | Direct integration with dbt using operators and custom tasks | Integrates with Fabric but may require additional configuration |
| Ease of Use | Requires Python proficiency and setup expertise | Intuitive, low-code interface integrated within Microsoft Fabric |
| Ecosystem & Extensibility | Broad community support and extensive plugin ecosystem | Seamless Microsoft integration, managed service environment |
| Monitoring & Debugging | Rich UI for visualizing DAGs and task states | Built-in monitoring, though slightly less customizable |