Forum Discussion
Dataset/Data storage capacity
This is what applies to your scenario:
In this documentation page it's specified 5.000.000 max rows stored in a non retention policy dataset (it seems I cannot configure it using Stream Analytics).
Does the dataset store new data using FIFO retention policy? Yes
Are these considerations applied to CosmosDB data source too? To streaming datasets, Cosmos falls into the 10GB as it is not a Direct Query supported data source.
For the streaming if you want to save the data you need to split it off and have stream analytics dump the data in a storage location in order to retain it. The cool thing with this scenario is that you can use Power BI to recieved the live data and show it in a dashboard, have a report that uses the FIFO of the retained storage, then connect other reports on the storage location where you would be piping the SA data to.
This is what applies to your scenario:
In this documentation page it's specified 5.000.000 max rows stored in a non retention policy dataset (it seems I cannot configure it using Stream Analytics).
Does the dataset store new data using FIFO retention policy? Yes
Are these considerations applied to CosmosDB data source too? To streaming datasets, Cosmos falls into the 10GB as it is not a Direct Query supported data source.
For the streaming if you want to save the data you need to split it off and have stream analytics dump the data in a storage location in order to retain it. The cool thing with this scenario is that you can use Power BI to recieved the live data and show it in a dashboard, have a report that uses the FIFO of the retained storage, then connect other reports on the storage location where you would be piping the SA data to.
Thank you very much! :)