Forum Discussion

mmmall's avatar
mmmall
Regular Visitor
9 months ago
Solved

Airflow Job: Run a DAG using API

Hi! We're using the Airflow Job in Fabric.   We need to trigger a DAG when a specific event (webhook) happens. For that, we should use the Airflow Job in the Fabric API.   I haven't been succes...
Apache Airflow Job
  • v-achippa's avatar
    v-achippa
    8 months ago

    Hi mmmall,

     

    Thank you for the response. Based on the screenshot here looks like the Fabric portal is calling the Airflow API using a session cookie, not a bearer token. Because of this internal authentication flow, it is not possible to reproduce the same call externally using a client-credentials token or any token we generate ourselves.

     

    Currently fabric does not provide a public API to directly trigger a DAG inside an Apache Airflow Job, that is why your direct API calls fail even with a valid token.

    The only supported approach is to trigger a Fabric item for example like a Notebook or Pipeline using the Fabric REST API and run the logic there.

     

    Thanks and regards,

    Anjan Kumar Chippa

v-achippa's avatar
v-achippa
Community Support
8 months ago

Hi @mmmall,

 

We wanted to kindly follow up to check if the solution I have provided for the issue worked? or let us know if you need any further assistance.

 

Thanks and regards,

Anjan Kumar Chippa

mmmall's avatar
mmmall
Regular Visitor
8 months ago

Hello Anjan,

 

Ideally we should be able to reach the Fabric Airflow Job through it's API directly by external apps, the workaround of using a Fabric Item that calls the API is a bit cumbersome.

  • v-achippa's avatar
    v-achippa
    Community Support
    8 months ago

    Hi mmmall,

     

    I understand the expectation. Currently fabric’s Airflow Job does not expose a public API so that external applications can call directly. The portal uses an internal authentication flow, which is why external requests cannot access the Airflow API.

    Because of this current limitation, the only supported approach is to trigger a fabric item through the Fabric REST API and run your logic there. If direct external API access is added in the future, the documentation will be updated.

     

    Thanks and regards,

    Anjan Kumar Chippa