Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Streaming data limitations

We have a requirement of generating reports on PowerBI for real time transactions. We have roughly 2000,000 transactions flowing in 1 day and we would like reports generated atleast for these number ...
Need Help
  • v-jingzhang's avatar
    v-jingzhang
    5 years ago

    Hi Anonymous 

    Real-time datasets are mainly designed to display real-time data in tiles on dashboards rather than for power bi reports. If you want to utilize more features of power bi reports and show real-time data, you may consider using DirectQuery mode to create your dataset in Power BI Desktop application.

     

    If you don't need real-time data in reports, you can also consider using Import mode to create a dataset and setting incremental refresh rule for it. You can decide for which period to store the data and only refresh the latest data. For example, store the data in latest 5 days and refresh the newly added data in latest day. And configure Scheduled refresh for this dataset.

     

    For a push dataset, it is created as a none retention policy dataset by default. You can use the defaultRetentionPolicy query parameter  to change this behavior. But for a streaming dataset, data is temporarily stored for only one hour to render the visuals on dashboard. Reference: Streaming-dataset-matrix

     

    Regards,
    Community Support Team _ Jing Zhang

v-jingzhang's avatar
v-jingzhang
Community Support
5 years ago

Hi Anonymous 

Real-time datasets are mainly designed to display real-time data in tiles on dashboards rather than for power bi reports. If you want to utilize more features of power bi reports and show real-time data, you may consider using DirectQuery mode to create your dataset in Power BI Desktop application.

 

If you don't need real-time data in reports, you can also consider using Import mode to create a dataset and setting incremental refresh rule for it. You can decide for which period to store the data and only refresh the latest data. For example, store the data in latest 5 days and refresh the newly added data in latest day. And configure Scheduled refresh for this dataset.

 

For a push dataset, it is created as a none retention policy dataset by default. You can use the defaultRetentionPolicy query parameter  to change this behavior. But for a streaming dataset, data is temporarily stored for only one hour to render the visuals on dashboard. Reference: Streaming-dataset-matrix

 

Regards,
Community Support Team _ Jing Zhang