Forum Discussion

angela_n's avatar
angela_n
Frequent Visitor
9 months ago
Solved

Unable to create airflow job

Hello Community,   Since yesterday, I have been trying to create an Airflow job, and I keep getting this error:   {"message"."Request failed with 500(Internal Server Error): {\"error\": {\"code\...
data engineering
  • AntoineW's avatar
    AntoineW
    9 months ago

    Hello angela_n,

     

    Since Apache Airflow in Fabric is a managed service that requires specific backend provisioning, a 500 error usually implies the service failed to allocate the necessary compute resources or containers for your instance.

     

    This is often caused by one of three things:

    • Region unavailability: New feature, so Apache Airflow Jobs are not yet available in all Azure regions where Fabric is deployed.

    • Tenant Setting Restrictions: The feature is disabled at the Tenant level, in preview.

    • Verify Capacity Assignment : Airflow Jobs require a genuine Fabric Capacity (F-SKU) or a Trial capacity. Not possible on Power BI Pro or PPU.

     

    References : 

    - https://learn.microsoft.com/en-us/fabric/data-factory/apache-airflow-jobs-concepts

    - https://learn.microsoft.com/en-us/fabric/data-factory/create-apache-airflow-jobs

     

    Hope it can help you!

    Best regards,

    Antoine

AntoineW's avatar
AntoineW
Icon for Super User rankSuper User
9 months ago

Hello angela_n,

 

Since Apache Airflow in Fabric is a managed service that requires specific backend provisioning, a 500 error usually implies the service failed to allocate the necessary compute resources or containers for your instance.

 

This is often caused by one of three things:

  • Region unavailability: New feature, so Apache Airflow Jobs are not yet available in all Azure regions where Fabric is deployed.

  • Tenant Setting Restrictions: The feature is disabled at the Tenant level, in preview.

  • Verify Capacity Assignment : Airflow Jobs require a genuine Fabric Capacity (F-SKU) or a Trial capacity. Not possible on Power BI Pro or PPU.

 

References : 

- https://learn.microsoft.com/en-us/fabric/data-factory/apache-airflow-jobs-concepts

- https://learn.microsoft.com/en-us/fabric/data-factory/create-apache-airflow-jobs

 

Hope it can help you!

Best regards,

Antoine