jill_bender's avatar
jill_bender
New Member
1 year ago
Status:
New

git sync does not work with Airflow

I have tried many times and many ways to get "git sync" to work with our Airflow repo. It appears this feature is currently broken for Azure Dev Ops.


Repro Steps:


  • Create an empty Azure DevOps repository
  • Go to "git sync" feature following instructions here: https://learn.microsoft.com/en-us/fabric/data-factory/data-workflows-sync-git-repo
  • Use a Personal Access Token and connect to repo per instructions.
  • Overserve Airflow is still running.
  • Add a new folder called "dag" with a hello_world DAG in it (dags/hello_world_dag.py). Push commit.
  • Open the Apache Airflow UI.
  • Notice DAG does not appear in DAGs in UI.
  • From the Fabric Airflow UI, stop Airflow.
  • Resume Airflow
  • Notice Airflow fails to resume.


2 Comments

  • I managed to get this working for both personal tokens and Service Principals, make sure you are using the "clone" HTTPS URL of your repo. That was my error before.

Recent ideas