topic Re: Cannot create eventstream from MySQL in Eventstream

Cannot create eventstream from MySQL

linardskalvanse — Mon, 05 Aug 2024 08:19:23 GMT

Hi,

I'm trying to set up Eventstream from Azure DB for MySQL, following the walkthru Add MySQL Database CDC as source in Real-Time hub - Microsoft Fabric | Microsoft Learn. However I get an error:

Create Eventstream source Failed Bad Request

without any further messages or hints. Has anyone succeeded with setting up Eventstream from MySQL or has encountered a similar error?

Re: Cannot create eventstream from MySQL

Anonymous — Tue, 06 Aug 2024 01:29:44 GMT

Hi linardskalvanse ,

According to the screenshot you provided, your Eventstream was created successfully but the data source connection failed. That should be a problem on your MySQL DB side.
First, please check your computer's firewall or other protective software to make sure that your MySQL is not behind a firewall and is publicly accessible.
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-source-mysql-database-change-data-capture#prerequisites

If you are the admin user of the MySQL, you can directly use the admin user to connect to the database which normally has the appropriate privileges already as below. But if you're not the admin user, you must define a MySQL user with appropriate privileges on all databases where the Messaging Connector can capture the changes from.

mysql> CREATE USER 'user'@'%' IDENTIFIED BY 'password'; mysql> GRANT SELECT, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user'@'%'; mysql> FLUSH PRIVILEGES; SHOW GRANTS FOR user;

https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-source-mysql-database-change-data-capture#set-up-mysql-db

The documentation link you provided also mentions that You must enable binary logging for MySQL replication.
https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/add-source-mysql-database-change-data-capture#enable-the-binlog

Please make sure that you have configured the above three points correctly.

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Cannot create eventstream from MySQL

linardskalvanse — Tue, 06 Aug 2024 05:56:43 GMT

Hi, Anonymous ,

thanks for your input, unfortunately it does not help. The database is properly set up and has all public access. As it is just a prototype, I'm using the admin user for connection. Moreover, I have set up successful CDC to Confluent cloud with the same DB user, this IMO indicates that the issue is not on the database side. The database error logs also do not show any errors.

Unfortunately it feels like blind poking as there is no logging of what actually happens in the Real time hub.

Re: Cannot create eventstream from MySQL

linardskalvanse — Tue, 06 Aug 2024 06:09:14 GMT

Oddly enouygh just noticed, that screenshot on the official how-to Add MySQL Database CDC as source in Real-Time hub - Microsoft Fabric | Microsoft Learn, shows the same "Bad Request" error 😀. So I suppose that the feature is just not yet ready (in the eventstream that was created, there are no events).

Re: Cannot create eventstream from MySQL

Anonymous — Thu, 15 Aug 2024 06:21:11 GMT

Hi linardskalvanse ,

Thank you for your feedback. The issue you mentioned is a known issue, and our team is currently working on a fix.

Best regards,

Wenyang