Real-Time Analytics Tutorial on MS Learn Fabric dataset not real time

[Dejo]

Hi, 

I just finished the tutorial and notice that the Yellow Taxi dataset (high data-rate) is not at all high rate or even updated, its only 2022 data. In the tutorial we set the refresh rate to 10 seconds indicating that more data will appear. Have i done something wring or is this just a "dry" practice? Thank you

Tutorial from MS Learn:
https://learn.microsoft.com/en-us/fabric/real-time-analytics/tutorial-introduction

[v-tangjie-msft · Accepted solution]

Hi @Dejo ,

Regarding the Yellow Taxi dataset you mentioned, it's important to note that the dataset used in the tutorial is a static snapshot of historical data, specifically designed for educational purposes. The refresh rate setting you encountered, such as setting it to 10 seconds, is part of the tutorial to demonstrate how Real-Time Analytics can be configured to handle high data-rate scenarios in a real-world application. However, the dataset itself does not update in real-time or receive new data beyond its current scope, which is why you're observing data only up to 2022.

This approach allows learners to focus on understanding and practicing with the tools and concepts of Real-Time Analytics without the complexity of handling live data streams. It's a "dry" practice in the sense that it simulates the process of working with high data-rate streams without the need for actual real-time data ingestion.

If you're interested in experimenting with real-time data, you might consider creating a simulation or using another data source that provides a live feed. This can offer a more dynamic experience and allow you to apply the concepts learned in the tutorial to a live scenario.

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

[Dejo]

Thank you, Neeko

[WillT]

If it helps: you can use the sample datasets in Eventstream or the simulated data in Data Activator to get real, moving, data. For example: 

Explore and transform sample bike-sharing data with Eventstream for KQL Database integration - Micro...

Data Activator tutorial using sample data - Microsoft Fabric | Microsoft Learn

Hope that helps!

[Dejo]

Yes, thank you!

This is what i was looking for. Will check it out further tomorrow at work.