Forum Discussion
Eventstream read EventHub with Avro format and Schema Registry (not schema embedded)
- 1 year ago
Hi khoa_nguyenanh , Thank you for reaching out to the Microsoft Community Forum.
As you observed, when Avro messages include the schema directly embedded in the payload, the pipeline will be read and process the data without any issues. This embedded schema approach is, as of now, the only supported method for Avro decoding in Eventstream. Microsoft has not yet announced support for resolving external schemas from Azure Schema Registry within Eventstream and there’s nothing on the public roadmap or in the documentation to suggest that this capability is coming soon. So, while it’s a reasonable expectation, it’s not something you can plan around at this stage.
If changing the producing application to embed schemas isn’t possible, there’s still a practical workaround. You can implement a lightweight middleware, typically using an Azure Function or Stream Analytics job that reads from your existing Event Hub, deserializes the Avro message using the Schema Registry, then re-serializes it with the schema embedded in the payload. That transformed message can be forwarded to another Event Hub, which Fabric Eventstream can consume.
If this helped solve the issue, please consider marking it “Accept as Solution” so others with similar queries may find it more easily. If not, please share the details, always happy to help.
Thank you.
Thanks you, Yes, Please close this thread.
There are some work around such as using Azure function or convert the EventHub to embedded schema but it's not acepted due to the real time requirement. So, it's pending at the moment.
Thanks again.
- v-hashadapu1 year ago
Community Support
Hi khoa_nguyenanh , thanks for the update. If you have any other queries, please feel free to make a new post. We are always happy to help.