Forum Discussion

Amit_K's avatar
Amit_K
Icon for Advocate I rankAdvocate I
1 year ago
Solved

Fabric Eventhouse Ingestion Capacity Scaling

Hi All,

 

has anyone tried concurrent writes into a Eventhouse table? It seems to allow only one ingestion request at a time . I confirmed by running the "show capacity" command. My eventhouse is on a F8 capacity , so I would expect the Ingestion Capacity to be 6, but it isn't. Is this a bug? Has anyone experienced or experiencing this problem?

 

Cheers,

Amit

  • Hi Amit_K ,

    Thank you for reaching out to Microsoft Community.

    Microsoft Fabric Eventhouse is designed to dynamically adjust compute resources based on your usage patterns, meaning capacity automatically scales to meet the demands of your workload. Several key factors influence how the compute size for an Eventhouse is determined, and understanding these can help you optimize both performance and cost.

    One of the most important factors is hot cache utilization. Each compute tier in Eventhouse provides a specific amount of hot cache capacity, which is used to store frequently accessed data. As your data volume approaches the limit of this cache, the system scales up the compute and cache space accordingly. Effective management of hot cache usage is therefore essential to avoid unnecessary scaling and to maintain optimal system performance.

    Another critical factor is ingestion utilization. Fabric continuously monitors the volume and frequency of incoming data to ensure timely ingestion. If your workload consistently uses 70% or more of the available ingestion capacity at the current compute size, Eventhouse will scale up based on ingestion needs. In such cases, even if there is minimal query or background activity, the compute size will remain elevated—or even increase further to accommodate the sustained ingestion load.

    It’s also important to consider the nature of your ingestion requests. If your requests are large or occur frequently, they may consume more than one Ingestion Unit ITU per request. This can reduce the effective concurrency, even in higher capacity tiers like F8, which theoretically supports six concurrent ingestion threads. In practice, however, concurrency can be limited by the actual resource consumption of each ingestion operation.

    Additionally, other workloads such as background processes or complex query executions—can impact the availability of resources for ingestion. This competition for resources can further constrain ingestion throughput and affect performance, especially under heavy or mixed workloads.

    If you're observing that only a single ingestion thread is being processed at a time, despite having a sufficient capacity tier like F8, this may be due to the cumulative impact of ingestion volume, cache pressure, and competing workloads. If these conditions don’t seem to explain the behavior you're seeing, 

    If your issue still persists, please consider raising a support ticket for further assistance.
    To raise a support ticket for Fabric and Power BI, kindly follow the steps outlined in the following guide:

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn


    Best Regards,
    Chaithra E.

4 Replies

  • v-echaithra's avatar
    v-echaithra
    Icon for Community Support rankCommunity Support

    Hi Amit_K ,

    Thank you for reaching out to Microsoft Community.

    Microsoft Fabric Eventhouse is designed to dynamically adjust compute resources based on your usage patterns, meaning capacity automatically scales to meet the demands of your workload. Several key factors influence how the compute size for an Eventhouse is determined, and understanding these can help you optimize both performance and cost.

    One of the most important factors is hot cache utilization. Each compute tier in Eventhouse provides a specific amount of hot cache capacity, which is used to store frequently accessed data. As your data volume approaches the limit of this cache, the system scales up the compute and cache space accordingly. Effective management of hot cache usage is therefore essential to avoid unnecessary scaling and to maintain optimal system performance.

    Another critical factor is ingestion utilization. Fabric continuously monitors the volume and frequency of incoming data to ensure timely ingestion. If your workload consistently uses 70% or more of the available ingestion capacity at the current compute size, Eventhouse will scale up based on ingestion needs. In such cases, even if there is minimal query or background activity, the compute size will remain elevated—or even increase further to accommodate the sustained ingestion load.

    It’s also important to consider the nature of your ingestion requests. If your requests are large or occur frequently, they may consume more than one Ingestion Unit ITU per request. This can reduce the effective concurrency, even in higher capacity tiers like F8, which theoretically supports six concurrent ingestion threads. In practice, however, concurrency can be limited by the actual resource consumption of each ingestion operation.

    Additionally, other workloads such as background processes or complex query executions—can impact the availability of resources for ingestion. This competition for resources can further constrain ingestion throughput and affect performance, especially under heavy or mixed workloads.

    If you're observing that only a single ingestion thread is being processed at a time, despite having a sufficient capacity tier like F8, this may be due to the cumulative impact of ingestion volume, cache pressure, and competing workloads. If these conditions don’t seem to explain the behavior you're seeing, 

    If your issue still persists, please consider raising a support ticket for further assistance.
    To raise a support ticket for Fabric and Power BI, kindly follow the steps outlined in the following guide:

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn


    Best Regards,
    Chaithra E.

  • v-echaithra's avatar
    v-echaithra
    Icon for Community Support rankCommunity Support

    Hi Amit_K ,

    We’d like to follow up regarding the recent concern. Kindly confirm whether the issue has been resolved, or if further assistance is still required. We are available to support you and are committed to helping you reach a resolution.

    Thank you for your patience and look forward to hearing from you.
    Best Regards,
    Chaithra E.

  • v-echaithra's avatar
    v-echaithra
    Icon for Community Support rankCommunity Support

    Hi Amit_K ,

    We wanted to follow up to see if the issue you reported has been fully resolved. If you still have any concerns or need additional support, please don’t hesitate to let us know, we’re here to help.

    We truly appreciate your patience and look forward to assisting you further if needed.

    Warm regards,
    Chaithra E.

  • v-echaithra's avatar
    v-echaithra
    Icon for Community Support rankCommunity Support

    Hi Amit_K ,

    We would like to confirm if you've successfully resolved this issue or if you need further help. If you still have any questions or need more support, please feel free to let us know. We are more than happy to continue to help you.

    Thank you for your patience and look forward to hearing from you.
    Best Regards,
    Chaithra E.