DAGRun via API
Hi, I am trying to find out how to run Airflow DAG via API call. When I called an API from swagger UI page, it works properly. (using /connection api as example for simplicity) However, if I called the same API from shell script or postman, it will always redirect me to microsoft login page. Is there a way to authenticate using shell script or do I need to change airflow Configuration Overrides to allow basic authentication (if possible)? Is it currently possible to run a DAG from a REST API call using basic authen or is there a way to authenticate using shell script ?
stuck with MS Learn Tutorial for Apache Airflow Jobs for dbt-fabric Orchestration
Hello, does anyone managed to implement the sample/tutorial Transform data using dbt - Microsoft Fabric | Microsoft Learn ? For us, with a Starter Pool running on Apache Airflow version 2.10.5, only the version of astronomer-cosmos==1.5.1 and dbt-fabric==1.5.0 are valid. ....but when running the DAG 'dags/my_cosmos_dag.py we systematically get a Failed to start error. Thanks
Transform data using dbt tutorial, not working
After successfully starting the Hello Airflow job example, I am trying a slightly modified version of this tutorial, in a new Airflow job: https://learn.microsoft.com/en-us/fabric/data-factory/apache-airflow-jobs-dbt-fabric The modification is that I am connecting to the default Warehouse with sample data, instead of the mentioned Contoso warehouse. The problem is that the DAG does not run, after trying multiple schedule intervals. Hopefully I have configured the DAG correctly, the only doubt I have is the database field in the profiles YAML file. Should that be the name of the warehouse? EDIT: I just discovered that there is a schedule interval set to daily, which means that the DAG will run at midnight on the day it is started, right? Is this a particulary beginner friendly setting for a tutorial? The tutorial also says to "press play", but this is a scheduled DAG right? EDIT 2: I have set the schedule interval to continuous, and start date two days ago, catchup to False still no DAGs are run. Where can I find the logs? Screenshots:Data workflows - Run a Microsoft Fabric Item Job
Has anyone been able to get a Fabric Data workflow to run a Fabric Item Job? Run a Microsoft Fabric item job in Apache Airflow DAGs. - Microsoft Fabric | Microsoft Learn I have the authentication working, but hitting this error and not sure where to find this module? I cannot find it on PyPI ModuleNotFoundError: No module named 'airflow.providers.microsoft.powerbi'
