Real-time data is crucial for enterprises to stay competitive, enabling instant decision-making, enhanced customer experiences, and operational efficiency. It helps detect fraud, optimize supply chains, and personalize interactions. By leveraging continuous data streams, businesses can unlock new opportunities, improve resilience, and drive smarter automation in a data-driven world.
What are Fabric Event Streams and Solace PubSub+?
Microsoft Fabric unifies various data analytics tools, offering a comprehensive suite for data storage, processing, and analysis. Real-Time Intelligence is a powerful service that empowers everyone in your organization to extract insights and visualize their real-time data. It offers an end-to-end solution for event-driven scenarios, streaming data, and data logs. Fabric Eventstream aims to establish a centralized place on the Fabric platform for seamlessly capturing real-time data from diverse sources, transforming it, and routing it to various destinations. The streaming connectors in Eventstream enable seamless connection of external real-time data streams to Fabric, providing an out-of-the-box experience and more options for real-time insights from a variety of sources.
Solace PubSub+ Platform is an event-driven integration and streaming solution that facilitates data flow between applications, devices, and users. It creates an event mesh that dynamically distributes events across global environments, breaking down data silos and enabling distributed event-driven systems.
Integrating Solace PubSub+ Platform with Microsoft Fabric Eventstream creates a strong pipeline for real-time event streaming and analytics. This integration enables organizations to use Solace's event management within Fabric's analytics ecosystem, offering immediate data-driven insights and decision-making.
Seamless Real-Time data integration with Microsoft Fabric Real-Time Intelligence & Solace PubSub+
Currently the Kafka Bridge in Solace PubSub+ can integrate with Kafka-based systems like Fabric Eventstream, but it requires configuration on both ends. For example, first, you will need to obtain the Kafka endpoint and the corresponding keys from an Eventstream item that is created in Fabric. Then, navigate to Solace PubSub+ Kafka Bridge in Solace Cloud system to configure the event broker and Kafka sender.
With this new streaming connector introduced in Fabric Eventstream, it simplifies the integration process. You can easily find this source in Real-Time hub. With just a few clicks and configurations in Fabric, the real-time events in Solace PubSub+ broker will be fetched into Eventstream for further transformation and routing.
Start streaming with Solace PubSub+ connector
Solace PubSub+ streaming connector source is now in preview, follow the steps below to use this feature.
Go to Real-Time hub, select Data source in the left pane, choose Solace PubSub+ (reference the screenshot above) and configure the parameters.
- In the connection setting dialog, input the Solace PubSub+ broker URL (with the SMF protocol in PLAIN-TEXT) and your client connection username and password information.
- In the source configuration, input the topic name or queue name where the events locate, and the ‘Message vpn name’.
Once the configuration is complete, you will receive a notification that the eventstream has been created and that the Solace PubSub+ source has been added to this eventstream with the streaming connector operational.
Open this eventstream in Live view, you will see the Solace source in an active state. Publish some events to the event broker (topic or queue, depending on your configuration). For example, use the sample sensor data below. The event will appear in Eventstream within seconds, as shown in the screenshot.
For step-by-step guide details of this connector source configuration, visit: the Fabric Eventstream - overview documentation.
Processing Solace Events in Fabric Real-Time Intelligence: analytics, alerts & more
When events from Solace reach Fabric Eventstream through this integration, it enables customers to use the rich real-time data analytics tools available in Fabric Real-Time Intelligence to address their real-time scenarios.
For example:
- Using Real-Time Intelligence Eventhouse, customers can analyze and explore large volumes of real-time data with Kusto Query Language (KQL) queries. The KQL queries can be exported to a Real-Time Dashboard as visuals to monitor and visualize the data. This integrated dashboard improves data exploration, query performance, and visualization.
- With Activator, customers can be alerted through multiple channels, such as emails, Teams when patterns or conditions are detected in real-time events.
- The Derived stream feature allows customers to reshape real-time data and represent it in a stream for further consumption or analysis by other users within the organization.
- Custom endpoint functionality permits customers to develop their own event-driven applications that consume events from Eventstream.
Integrating Solace PubSub+ with Fabric Eventstream enables customers to leverage Fabric Real-Time Intelligence for real-time data processing, analytics, and event-driven actions on their Solace events, including large-scale event analysis, real-time alerts, data transformation, and event consumption with custom applications.
Try it now and share your feedback with us.
The Solace PubSub+ streaming connector is now in public preview. Try it with your Fabric account. If you don’t have one, sign up for Power BI with a new Microsoft 365 trial and start a free Fabric trial capacity. Learn more about Eventstream.
We welcome your feedback through the community forum, idea submission, or via email.