Forum Discussion
Leveraging Fabric Mirrored as source database in event stream
Hi robertpayne21 ,
Mirrored databases in Fabric are designed primarily for replication and analytics-ready data storage, rather than direct event streaming. They replicate your existing data estate into Fabric's OneLake in an analytics-ready format, such as Parquet, and are typically used for batch analytics rather than real-time event processing. This might explain why you're not seeing events passed when attempting to use a mirrored database as a direct source for an event stream.
For real-time event processing and streaming into Power BI, you would generally need a source that can generate or capture events in real-time, such as Azure Event Hubs or IoT Hubs, which can then be connected to an event stream in Fabric.
There are some possible methods for your reference:
1. Consider using a standard SQL instance with Change Data Capture (CDC) enabled. CDC captures changes in the database and can be used as a source for your event stream.
The flow would be: Snowflake DB → Standard SQL DB with CDC → Event Stream → Power BI Report.
2. Direct Snowflake to Event Hub Integration->Event Hub to Fabric Event Stream->Event Stream to Power BI.
Best Regards,
Neeko Tang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi robertpayne21 ,
Mirrored databases in Fabric are designed primarily for replication and analytics-ready data storage, rather than direct event streaming. They replicate your existing data estate into Fabric's OneLake in an analytics-ready format, such as Parquet, and are typically used for batch analytics rather than real-time event processing. This might explain why you're not seeing events passed when attempting to use a mirrored database as a direct source for an event stream.
For real-time event processing and streaming into Power BI, you would generally need a source that can generate or capture events in real-time, such as Azure Event Hubs or IoT Hubs, which can then be connected to an event stream in Fabric.
There are some possible methods for your reference:
1. Consider using a standard SQL instance with Change Data Capture (CDC) enabled. CDC captures changes in the database and can be used as a source for your event stream.
The flow would be: Snowflake DB → Standard SQL DB with CDC → Event Stream → Power BI Report.
2. Direct Snowflake to Event Hub Integration->Event Hub to Fabric Event Stream->Event Stream to Power BI.
Best Regards,
Neeko Tang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi Anonymous, my apologies for the delayed response. I will give this a test and circle back. Thank you for your response, it is appreciated.
Thanks,
Robert
Hi robertpayne21 ,
Has your problem been solved? If the problem has been solved you can mark the reply for the standard answer to help the other members find it more quickly. If not, please point it out. Thanks in advance.
Best Regards,
Neeko Tang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.