Handling Multiple Schemas in Eventstream for Azure Event Hub and Azure IOT Hub data sources
One of the challenges with streaming data is that data comes in a variety of schemas, which can be dynamic and are not always predictable. As applications and data structures change, schema values can sometimes be wildly different across devices or event inputs. Recently a customer reached out with several questions on this common problem. With the capabilities in Fabric Real Time Intelligence we can flexibly ingest this data. Enough of the background let’s get to the problem!Stop Polling, Start Reacting: Building Bulletproof Event-Driven Pipelines in Microsoft Fabric
I just stepped off the stage at SQLSaturday Atlanta and the energy around Microsoft Fabric is absolutely electric. Between the deep-dive sessions and the hallway conversations, one question kept coming up: “How do we make our data orchestration more efficient?” In the world of Synapse and Data Factory, we’ve been conditioned to “Poll.” We set a schedule to check a table every 15 minutes, 24/7. But in a Capacity-based world like Fabric, “Polling” is essentially a tax on your resources. Today, I’m sharing the framework I demoed in Atlanta – moving from expensive “Ghost Pipelines” to a lean, event-driven architecture that only works when there is a “doorbell” to answer.
Optimizing Real-Time Analytics in Microsoft Fabric RTI with Follower and Read-Optimized Databases
This article discusses about an architectural pattern to achieve better performance when trying to work with traditional relational database schema in Microsoft Fabric Real Time Intelligence (RTI). A common scenario is that you have Fabric as the enterprise data platform that ingests data from a live system running at scale. This article addresses two common requirements: You have streaming ingestion with variety of consumers for the data. You have use cases that demand fast response time even when the query is joining huge tables. The pattern discussed here uses a database shortcut in Fabric RTI, also known as a follower database, and a read-write database. With the database shortcut, each downstream system gets dedicated capacity and SLAs. With a read-write database, data can be denormalized and stored in a read-optimized format to improve real time query performance.Learning Fabric Real-Time Intelligence as a Business/Front-end Oriented User
Fabric Real-Time Intelligence isn’t just for developers. Learn how to start small, stay curious, and use resources like the Kusto Detective Challenge and Microsoft’s tutorial to build dashboards that drive action in real time.Comparing JSON in Eventhouse Without Defining Schema
When working with raw JSON data in Eventhouse, one common challenge is comparing two records to identify what changed—especially when the structure isn’t fixed. Fields may appear, disappear, or shift in type, making traditional column-based comparisons brittle or outright impossible. This post will walk you through how to compare two JSON arrays and find what changed without needing to define the schema first.Refresh on change detection - Real-time data & Power BI
When monitoring real-time data, you want updates as soon as new data comes in, but without unnecessary refreshes. This is where page refreshes based on change detection in Power BI become useful. For example, if new data arrives every five minutes, refreshing a report ten times per minute is inefficient. Power BI’s change detection refresh option updates the page only when a specific field changes!Migrating to Fabric RTI from ADX
Migrating to Microsoft Fabric Real-Time Intelligence (RTI) from Azure Data Explorer (ADX) offers several benefits for organizations looking to enhance their data analytics capabilities. This article outlines how to efficiently migrate from ADX to Fabric RTI. Dive into the future of data analytics with Fabric RTI and see how it can transform your business operations.
Easily recreate your ADX dashboards as Real-Time Dashboards in Fabric
Discover how to effortlessly recreate your ADX dashboards as Real-Time Dashboards in Microsoft Fabric—without moving your data. Connect directly to your ADX clusters, leverage powerful Fabric features like permissions management and real-time collaboration, and unlock new possibilities for data-driven insights.
