Forum Discussion
Streaming dataset
Hello, I have tried the streaming dataset using API to push data to the dataset from a Databricks notebook, and this works well. However, a message appears: this feature will be retired soon. Qu...
Hello ollieftw,
Thank you for reaching out to the Microsoft Fabric Forum Community.
The Power BI streaming datasets are being deprecated, you can replicate and enhance this functionality using Real-Time Intelligence in Microsoft Fabric, specifically with Eventstreams and Real-Time Dashboards. Here’s how you can transition:
- In the Real-Time Hub, create an Eventstream and use its Apache Kafka endpoint as the target for your Databricks notebook. Update your notebook to push data to this endpoint using a Kafka producer library.
- Route the Eventstream data to an Eventhouse for scalable storage and querying or a Lakehouse for Delta table storage.
- Create a Real-Time Dashboard in Fabric, connect it to the Eventhouse, and use KQL queries to visualize live data, like your Power BI streaming dataset dashboard and Use Fabric Activator to set up real-time alerts for specific data patterns.
For a detailed guide, check out the Real-Time Intelligence tutorial. If you’re using a Custom App to push data, ensure your Fabric capacity is at least F4 to support Eventstreams.
If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
Thank you.