topic Re: Cosmos DB CDC Warning in Eventstream

Cosmos DB CDC Warning

BW_RFA — Fri, 24 May 2024 12:28:11 GMT

Hi all,

I am trying to connect my Cosmos DB NoSQL database to an eventstream using the new Real Time Hub.

I can access the DB using mirroring and dataflows so the connection is fine.

I have enabled Synapse Link on the Database that I want to stream.

I am following this guide:

https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-source-azure-cosmos-db-change-data-capture

, but getting the following "Warning" and no data is coming through the stream. For this, I am manually entering the database name and container ID. There is no further error message or anything in the runtime logs that I can see.

All help appreciated.

Thanks

Re: Cosmos DB CDC Warning

Anonymous — Mon, 27 May 2024 07:12:13 GMT

Hi BW_RFA ,

Please try these ways:
As per the Data Activator limitations, the supported throughput for Eventstreams data sources is up to two events per second. If the data is sent at a more frequent rate, it may be throttled, resulting in no data being processed in the stream.
https://learn.microsoft.com/en-us/fabric/data-activator/data-activator-limitations#maximum-data-throughput-for-eventstreams-data
Ensure that the Azure Cosmos DB Change Data Capture (CDC) source connector is configured correctly. This includes entering the exact database name and container ID you are referring to, and ensuring that your data source is available and not blocked by a firewall.

Process event data with the event processor editor - Microsoft Fabric | Microsoft Learn

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Cosmos DB CDC Warning

BW_RFA — Tue, 28 May 2024 07:45:42 GMT

Hi Anonymous ,

Thanks for getting back to me.

I am not using Data Activator yet, just EventStreams in Real Time Hub. I cannot see any data in the EventStreams at all and just get a "Warning" status without an error message.

I have all the correct permissions and have typed the data in properly. I am in UK South as well.

Are there any settings/config I need to set on the Cosmos DB account?

Thanks

Re: Cosmos DB CDC Warning

BW_RFA — Tue, 28 May 2024 08:46:41 GMT

Anonymous

I believe the problem is that I am in a trial and not a premium capacity within our tenant. I will upgrade to a paid capacity and see if this fixes the problem.