Forum Discussion
Transform data using dbt tutorial, not working
Hi BiJoe,
Yes, you're correct! When a DAG is set with a daily schedule interval, it will run at midnight on the day it is started. While this can be a common setting, it might not be the most beginner-friendly option for a tutorial since it can lead to confusion about immediate execution.
- Regarding the "press play" instruction, that typically refers to manually triggering the DAG. You can start a DAG by clicking on the three dots in the Airflow UI and selecting "Trigger DAG."
- As for your edited question about finding the logs, you can access the logs within the Airflow UI. Once you trigger a DAG, you can click on the DAG name, then go to the "Graph View" or "Gantt View," and click on the task you want to inspect. This will lead you to the logs for that specific task or click on the logs button inside a DAG in Airflow UI.
If you still encounter issues with your DAGs not running, double-check your configurations and the Airflow scheduler status.
Let me know if you need further assistance!
Best regards,
Sai Prudhvi Neelakantam
Data Engineer | 3x Microsoft CertifiedLinkedIn: in/saiprudhvineelakantam | geekindata.com
If this helps, kindly mark this as the accepted solution! 👍
Hi BiJoe
In Fabric, the database field should be the name of the warehouse you want to connect to. Make sure it matches the default warehouse name in the Fabric with the sample data.
If the scheduling interval is set to daily, the DAG will run at midnight (UTC time) on the day it starts.
Even if the DAG is a scheduled task, you can trigger it manually by pressing the Play button in Airflow UI.
About Monitoring DAG:
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Anonymous thanks for replying.
Unfortunately there is no Play button in Airflow UI for the DAG I have replicated from the tutorial.
Thanks for the link about monitoring DAGs, but that does not work so long the DAG does not run properly.
Hi BiJoe,
Yes, you're correct! When a DAG is set with a daily schedule interval, it will run at midnight on the day it is started. While this can be a common setting, it might not be the most beginner-friendly option for a tutorial since it can lead to confusion about immediate execution.
- Regarding the "press play" instruction, that typically refers to manually triggering the DAG. You can start a DAG by clicking on the three dots in the Airflow UI and selecting "Trigger DAG."
- As for your edited question about finding the logs, you can access the logs within the Airflow UI. Once you trigger a DAG, you can click on the DAG name, then go to the "Graph View" or "Gantt View," and click on the task you want to inspect. This will lead you to the logs for that specific task or click on the logs button inside a DAG in Airflow UI.
If you still encounter issues with your DAGs not running, double-check your configurations and the Airflow scheduler status.
Let me know if you need further assistance!
Best regards,
Sai Prudhvi Neelakantam
Data Engineer | 3x Microsoft CertifiedLinkedIn: in/saiprudhvineelakantam | geekindata.com
If this helps, kindly mark this as the accepted solution! 👍
