topic Re: Real-Time Stream Analytics Blob Storage data from Application Insights in Developer

Real-Time Stream Analytics Blob Storage data from Application Insights

Jpadda — Tue, 21 Nov 2017 15:06:07 GMT

HI,

I'm attempting to get some real-time metrics from Application Insights into Power BI. I'm using Continuous Export in AI to push "Exceptions" into blob storage. I'm then using Stream Analytics (using a custom JavaScript function to flatten the data), and pushing this to Power BI. This works nicely. However, I find that I have to update the page or hit refresh to get the latest information in Power BI, i.e. it is not real-time.

Note, sometimes, there are no Exceptions thrown in Application Insights, so the visualization will not change.
To create real-time metrics, I created a Dashboard and tried adding a tile from "Custom Streaming Data" . This pointed to my StreamAnalytics dataset.

In my data set, I have a count, which will always be 1 when there's an exception, and a timestamp.

If there is no data to process with a real-time card, will Power BI just show nothing, or will it show that at the current time, the Exception count was 0? I was hoping for a real-time chart that would show 1, when there was an exception, and 0 if there wasn't.

Thanks

Padda

Re: Real-Time Stream Analytics Blob Storage data from Application Insights

Eric_Zhang — Wed, 22 Nov 2017 08:00:37 GMT

@Jpadda wrote:

HI,

I'm attempting to get some real-time metrics from Application Insights into Power BI. I'm using Continuous Export in AI to push "Exceptions" into blob storage. I'm then using Stream Analytics (using a custom JavaScript function to flatten the data), and pushing this to Power BI. This works nicely. However, I find that I have to update the page or hit refresh to get the latest information in Power BI, i.e. it is not real-time.

Note, sometimes, there are no Exceptions thrown in Application Insights, so the visualization will not change.
To create real-time metrics, I created a Dashboard and tried adding a tile from "Custom Streaming Data" . This pointed to my StreamAnalytics dataset.

In my data set, I have a count, which will always be 1 when there's an exception, and a timestamp.

If there is no data to process with a real-time card, will Power BI just show nothing, or will it show that at the current time, the Exception count was 0? I was hoping for a real-time chart that would show 1, when there was an exception, and 0 if there wasn't.

Thanks

Padda

@Jpadda

Per my test, when there's no new data pushed in, the card visual will show current value for one hour, after one hour it only shows the Power BI water mark. So you may have to push data in a interval less than one hour.

Re: Real-Time Stream Analytics Blob Storage data from Application Insights

Jpadda — Wed, 22 Nov 2017 08:25:20 GMT

Thank you Eric, that is very helpful.

On a related note, is it possible to get this working with a line chart with a time interval of say 10 minutes, where the X-Axis is time, and the Y axis is the value sent from Stream Analytics?

Will the line chart continue to be processed if there's no data being sent to Power BI from Stream Analytics? What I mean is, will the X-axis continue to progress time, even if no data is being sent to it? My aim is to display real-time metrics... but there will be periods of time when nothing is sent to PowerBI, but I'd like it to continue processing, but showing 0.

Thank you.