Forum Discussion

DC07's avatar
DC07
Frequent Visitor
1 year ago

Eventsteam custom endpoint(event hub) message size limit

I'm getting an error sending messages to a custom end point in an event stream that the message is too big "The maximum message size quota for outgoing messages (1048576) has been exceeded"

why is the max message size only 1mb? I have the same limit in Azure event hubs.

What other ways can I receive messages in real time that are larger than 1mb

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi DC07 ,

     

    The 1 MB limit for message size in Azure Event Hubs and similar services is primarily due to performance and reliability considerations. Larger messages can significantly impact the throughput and latency of the system, leading to potential bottlenecks and increased resource consumption.

    Quotas and limits - Azure Event Hubs - Azure Event Hubs | Microsoft Learn

     

    However, there are ways to handle larger messages in real-time:

    1.You can use Azure Event Hubs dedicated clusters, which support large messages up to 20 MB. This feature is currently in public preview and allows you to stream large messages without additional charges.

    Quickstart: Send and receive large messages with Azure Event Hubs (preview) - Azure Event Hubs | Microsoft Learn

    2.Azure Service Bus supports larger messages, with a maximum size of 256 KB in the standard tier and up to 100 MB in the premium tier.

    How can we send message size larger than 1MB to EventHub - Microsoft Q&A

    3.Split your large messages into smaller chunks that fit within the 1 MB limit and send them as separate messages. You can then reassemble these chunks at the receiving end.

     

    Best Regards,

    Neeko Tang

    If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

  • datacoffee's avatar
    datacoffee
    Icon for Most Valuable Professional rankMost Valuable Professional

    On the configuration of the Eventstream you can configure the max message size - this should be the place to change this and have the messages running through 

    • DC07's avatar
      DC07
      Frequent Visitor

      where? there is a setting for event throughput, but this has nothing to do with message size

      • datacoffee's avatar
        datacoffee
        Icon for Most Valuable Professional rankMost Valuable Professional

        Sorry my bad - I misunderstood your question.