Forum Discussion

raghulvl's avatar
raghulvl
Frequent Visitor
3 months ago
Solved

SQL Server CDC on VM DB Source Fails with "Property 'username' value '' is invalid" in Fabric Events

Hi Community, I am trying to build a real-time ingestion pipeline in Microsoft Fabric using the following architecture: SQL Server (On-Premises) in my local laptop → Eventstream (SQL Server CDC on ...
Real-Time hub
  • raghulvl's avatar
    raghulvl
    3 months ago

    Hey v-dineshya ,

    I wanted to share an update that I have successfully completed my Proof of Concept (POC) for streaming real-time data from SQL Server into Microsoft Fabric.

    After evaluating a few approaches, I achieved the desired low-latency pipeline by implementing the following architecture:

    SQL CDC → (Debezium + Kafka) → (Azure Event Hubs / Confluent.io) → Fabric Eventstream (via Event Hub or Confluent Connector)

    Why this approach worked well:

    • Log-Based CDC: By using Debezium, the pipeline reads from the SQL transaction logs directly, ensuring zero impact on primary database query performance.

    • Scalability: Routing the data through Kafka/Event Hubs provides a highly reliable, buffered streaming layer.

    • Native Integration: Fabric’s native Eventstream connectors made it incredibly straightforward to ingest the stream directly into the lakehouse for real-time analytics.

    Thanks to everyone for the guidance and support throughout this process! Hopefully, this architectural flow helps anyone else looking to implement a similar real-time CDC pattern.

    Cheers!

v-dineshya's avatar
v-dineshya
Icon for Community Support rankCommunity Support
3 months ago

Hi raghulvl ,

Thank you for reaching out to the Microsoft Community Forum. It is a Fabric Eventstream CDC connector  issue(limitation). The connector successfully reaches the gateway and it starts metadata discovery but the credential payload passed internally is missing the username. When selecting an existing gateway connection, the CDC connector sometimes uses stored credentials for connection test and fails to propagate credentials to the internal createEventTypes API call.

Please try below general workarounds.

1. Instead of selecting the saved connection, in Eventstream source setup: Choose “Create new connection” and manually enter Server name, Database name, Authentication type, Username, Password and Gateway name.

2. Use server name with port number. Sometimes instance names cause issues with CDC connectors.

ex:- TRELLIS000121,1433

3. Please delete and recreate the connection with Authentication --> Basic, Explicit gateway selection and avoid editing existing connection.

4. Please try Fabric Lakehouse shortcut, use Data Pipeline --> CDC ingestion.

 

Please refer below community threads.

Solved: Re: SQL Server on VM DB Error - Microsoft Fabric Community

Solved: Eventstream - SQL Server CDC on VM DB Error - Microsoft Fabric Community

Solved: Re: Cannot create Eventstream from SQL Server (CD... - Microsoft Fabric Community

 

One of the user was already raised an idea regarding this limitation in Microsoft ideas forum, please refer below link.

Please allow CDC from On-Premise SQL Server (via g... - Microsoft Fabric Community

 

I hope this information helps. Please do let us know if you have any further queries.

 

Regards,

Dinesh