Learn how to configure an event-driven data pipeline that automatically gets triggered when a new file lands in OneLake or Azure Blob Storage, to ingest and transform the new file.

Read more...

One of the challenges with streaming data is that data comes in a variety of schemas, which can be dynamic and are not always predictable. As applications and data structures change, schema values can sometimes be wildly different across devices or event inputs. Recently a customer reached out with several questions on this common problem. With the capabilities in Fabric Real Time Intelligence we can flexibly ingest this data. Enough of the background let’s get to the problem!

Read more...

When working with raw JSON data in Eventhouse, one common challenge is comparing two records to identify what changed—especially when the structure isn’t fixed. Fields may appear, disappear, or shift in type, making traditional column-based comparisons brittle or outright impossible. This post will walk you through how to compare two JSON arrays and find what changed without needing to define the schema first. 

Read more...

Following quentincarton's deep dive into integrating ServiceNow with Microsoft Fabric Real Time Intelligence, this follow-up explores how to truly harness that data once it's flowing. From real-time dashboards and text analytics to automated alerts and Power BI reporting, discover how to turn your ServiceNow incidents into actionable insights—live, as they happen. Learn how Eventhouses and Notebooks in Fabric can help you extract key phrases, visualize trends, and even trigger downstream processes in real time.

🔍Ready to see your ticketing data in a whole new light? Dive into the possibilities!

Read more...

When monitoring real-time data, you want updates as soon as new data comes in, but without unnecessary refreshes. This is where page refreshes based on change detection in Power BI become useful.

For example, if new data arrives every five minutes, refreshing a report ten times per minute is inefficient. Power BI’s change detection refresh option updates the page only when a specific field changes!

Read more...

Join a Microsoft Fabric Reddit Ask me Anything on March 5th at 10 AM PT with the Real-Time Intelligence team! 

Read more...

Discover how to enhance your Azure/Fabric Data Factory pipelines with real-time telemetry using Microsoft Fabric RTI. Learn to seamlessly send diagnostic data to Eventhouses, enabling you to create dynamic dashboards and alerts for better performance monitoring and error troubleshooting. This guide walks you through setting up a flexible, schema-agnostic table and integrating it with your pipelines for instant insights. Transform your data analytics with ease and efficiency—explore the full potential of Fabric Real Time Intelligence today!

Read more...

Discover how to effortlessly recreate your ADX dashboards as Real-Time Dashboards in Microsoft Fabric—without moving your data. Connect directly to your ADX clusters, leverage powerful Fabric features like permissions management and real-time collaboration, and unlock new possibilities for data-driven insights.

Read more...

Much of the conversation around Microsoft Fabric rightly focuses on gaining insights from our data. But what if the insights we reveal demand immediate action to mitigate a problem in real-time or, better yet, prevent a problem from occurring in the first place? Data Activator allows us to do just that within Real-Time Intelligence in Microsoft Fabric. If you're reading this and saying "what's Data Activator?", you've come to the right place.

Read more...

Real-Time Intelligence might mean different things to different people but I try to help explain what it means in the context of Microsoft Fabric.

Read more...

You might be familiar with setting an alert on a visual in a Power BI Dashboard, but Data Activator can provide more functionality and add value to your alerts!

Read more...

The Real-Time Intelligence service in Fabric can help you deploy an Event Hub directly with a few clicks with your mouse.

 

The Eventstream processor is your go-to service to get this done - read this post to learn how to deploy it and how to use it.

Read more...

Collecting data using Microsoft Forms is a common practice, and analyzing the responses in real time is incredibly valuable. In the past, many users relied on the Streaming Semantic Model (Dataset) in Power BI to capture and visualize live data. However, with the recent retirement of this feature, it's time to use Microsoft Fabric Real-Time Intelligence as the new solution for live reporting.

Read more...

I work with a lot of clients that are creating analytic systems. They all collect large numbers of data points and analyze them. Most do a fairly good job with it.

 

Bue one area that I see very few handling well, is the data that is missing, rather than just the data that is present. There's a huge difference between data that arrived, and is odd, and data that just didn't arrive at all.

 

One tool that's great at working with streams of data is the Real Time Intelligence workload for Microsoft Fabric. And it's also great at working with data that is missing from those streams.

Read more...