Forum Discussion
Transform data using dbt tutorial, not working
Hi BiJoe,
Yes, you're correct! When a DAG is set with a daily schedule interval, it will run at midnight on the day it is started. While this can be a common setting, it might not be the most beginner-friendly option for a tutorial since it can lead to confusion about immediate execution.
- Regarding the "press play" instruction, that typically refers to manually triggering the DAG. You can start a DAG by clicking on the three dots in the Airflow UI and selecting "Trigger DAG."
- As for your edited question about finding the logs, you can access the logs within the Airflow UI. Once you trigger a DAG, you can click on the DAG name, then go to the "Graph View" or "Gantt View," and click on the task you want to inspect. This will lead you to the logs for that specific task or click on the logs button inside a DAG in Airflow UI.
If you still encounter issues with your DAGs not running, double-check your configurations and the Airflow scheduler status.
Let me know if you need further assistance!
Best regards,
Sai Prudhvi Neelakantam
Data Engineer | 3x Microsoft CertifiedLinkedIn: in/saiprudhvineelakantam | geekindata.com
If this helps, kindly mark this as the accepted solution! 👍
Anonymous thanks for replying.
Unfortunately there is no Play button in Airflow UI for the DAG I have replicated from the tutorial.
Thanks for the link about monitoring DAGs, but that does not work so long the DAG does not run properly.
Hi BiJoe,
Yes, you're correct! When a DAG is set with a daily schedule interval, it will run at midnight on the day it is started. While this can be a common setting, it might not be the most beginner-friendly option for a tutorial since it can lead to confusion about immediate execution.
- Regarding the "press play" instruction, that typically refers to manually triggering the DAG. You can start a DAG by clicking on the three dots in the Airflow UI and selecting "Trigger DAG."
- As for your edited question about finding the logs, you can access the logs within the Airflow UI. Once you trigger a DAG, you can click on the DAG name, then go to the "Graph View" or "Gantt View," and click on the task you want to inspect. This will lead you to the logs for that specific task or click on the logs button inside a DAG in Airflow UI.
If you still encounter issues with your DAGs not running, double-check your configurations and the Airflow scheduler status.
Let me know if you need further assistance!
Best regards,
Sai Prudhvi Neelakantam
Data Engineer | 3x Microsoft Certified
LinkedIn: in/saiprudhvineelakantam | geekindata.com
If this helps, kindly mark this as the accepted solution! 👍