Forum Discussion
Real-Time Analytics Tutorial on MS Learn Fabric dataset not real time
Hi,
I just finished the tutorial and notice that the Yellow Taxi dataset (high data-rate) is not at all high rate or even updated, its only 2022 data. In the tutorial we set the refresh rate to 10 seconds indicating that more data will appear. Have i done something wring or is this just a "dry" practice? Thank you
Tutorial from MS Learn:
https://learn.microsoft.com/en-us/fabric/real-time-analytics/tutorial-introduction
Hi Dejo ,
Regarding the Yellow Taxi dataset you mentioned, it's important to note that the dataset used in the tutorial is a static snapshot of historical data, specifically designed for educational purposes. The refresh rate setting you encountered, such as setting it to 10 seconds, is part of the tutorial to demonstrate how Real-Time Analytics can be configured to handle high data-rate scenarios in a real-world application. However, the dataset itself does not update in real-time or receive new data beyond its current scope, which is why you're observing data only up to 2022.
This approach allows learners to focus on understanding and practicing with the tools and concepts of Real-Time Analytics without the complexity of handling live data streams. It's a "dry" practice in the sense that it simulates the process of working with high data-rate streams without the need for actual real-time data ingestion.
If you're interested in experimenting with real-time data, you might consider creating a simulation or using another data source that provides a live feed. This can offer a more dynamic experience and allow you to apply the concepts learned in the tutorial to a live scenario.
Best Regards,
Neeko Tang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
4 Replies
Hi Dejo ,
Regarding the Yellow Taxi dataset you mentioned, it's important to note that the dataset used in the tutorial is a static snapshot of historical data, specifically designed for educational purposes. The refresh rate setting you encountered, such as setting it to 10 seconds, is part of the tutorial to demonstrate how Real-Time Analytics can be configured to handle high data-rate scenarios in a real-world application. However, the dataset itself does not update in real-time or receive new data beyond its current scope, which is why you're observing data only up to 2022.
This approach allows learners to focus on understanding and practicing with the tools and concepts of Real-Time Analytics without the complexity of handling live data streams. It's a "dry" practice in the sense that it simulates the process of working with high data-rate streams without the need for actual real-time data ingestion.
If you're interested in experimenting with real-time data, you might consider creating a simulation or using another data source that provides a live feed. This can offer a more dynamic experience and allow you to apply the concepts learned in the tutorial to a live scenario.
Best Regards,
Neeko Tang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Thank you, Neeko
If it helps: you can use the sample datasets in Eventstream or the simulated data in Data Activator to get real, moving, data. For example:
Data Activator tutorial using sample data - Microsoft Fabric | Microsoft Learn
Hope that helps!
