topic Re: stream analytics as streaming dataset source in Power Query

stream analytics as streaming dataset source

tgs — Thu, 15 Sep 2016 10:58:40 GMT

I've seen multiple examples in the internet where the new streaming dataset is used. All the examples have three options for the data source (see picture):

API
Stream Analytics
PUBNUB

Unfortunately my PowerBI provides only "API" and "PUBNUB". What can I do to activate Stream Analytics?

Re: stream analytics as streaming dataset source

Anonymous — Fri, 16 Sep 2016 07:05:50 GMT

Hi tgs,

There are only two options for the data source on my side, you can check the following screenshot.

Moreover, as stated in this official article, there are two ways to create a real-time streaming data feed that can be consumed and visualized by Power BI. And only API and PubNub data sources appear in the screenshot of the official article.

• Power BI REST API using a real-time streaming endpoint
• PubNub

If you want to output Real-Time Azure Stream Analytics data to a Power BI Dashboard, you can follow the steps in this article.

Thanks,
Lydia Zhang

Re: stream analytics as streaming dataset source

tgs — Mon, 19 Sep 2016 09:02:21 GMT

I saw the following articles. In both I can find SA as Data Source.

Re: stream analytics as streaming dataset source

Anonymous — Mon, 19 Sep 2016 09:58:02 GMT

Hi tgs,

As mentioned in the second blog you have posted, streaming data sets can be now either API, Azure Stream Analytics (coming soon), and PubNub. The option for Azure Stream Analytics is not released yet. We would need to wait some time to use it.

Currently, you can create a real-time dashboard for Azure Stream Analytics following the steps in this blog:http://radacad.com/stream-analytics-and-power-bi-join-forces-to-real-time-dashboard .

Thanks,
Lydia Zhang

Re: stream analytics as streaming dataset source

sirui_sun — Tue, 27 Sep 2016 17:06:54 GMT

To build onto Lydia's answer:

We are currently working on having a feature to enable ASA to output to Power BI via streaming datasets. This will in turn allow you to create streaming tiles based on ASA outputs. Later this year, we plan to have a private preview for this feature. If you're interested, please PM me, and I'll add you to our private preview list.

Thanks!

-Sirui

Re: stream analytics as streaming dataset source

bjagpal — Mon, 17 Oct 2016 20:03:03 GMT

I am also interested in creating live dashboards on Power BI, using streaming data from ASA (if possible, I would like to be notified of the private preview as well).

In the meantime, I have set up a streaming analytics service as outlined in the two links mentioned previously:

1 - https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-power-bi-dashboard/

2 - http://radacad.com/stream-analytics-and-power-bi-join-forces-to-real-time-dashboard

Everything is working as expected - I am sucessfully streaming data (JSON) from my event hub to Power BI. The only problem is that the numerical values in the data are being interpreted as a string type; therefore I cannot get any of the graph visualizations to work correctly. I had the same problem when using Power BI Desktop (with data being imported from Azure table storage), however, that application allowed me to "shape" the data, and modify the data types if necessary. I simply changed the type from a string to a decimal and everything worked correctly (of course the desktop application can only create "snapshot" reports, and not real time or "live" charts).

Is there a way I can change the data type using the Power BI web application? There could be an issue with my ASA Query but the data is being transferred...

Select
timecreated,
Out,
Ex,
Rm,
Name
from devicesinput TIMESTAMP by timecreated

Thanks in advance.

sirui_sun wrote:
To build onto Lydia's answer:

We are currently working on having a feature to enable ASA to output to Power BI via streaming datasets. This will in turn allow you to create streaming tiles based on ASA outputs. Later this year, we plan to have a private preview for this feature. If you're interested, please PM me, and I'll add you to our private preview list.

Thanks!
-Sirui

of the following links

Re: stream analytics as streaming dataset source

sirui_sun — Mon, 17 Oct 2016 21:45:14 GMT

Hello - unfortunately, there's no easy way to change the data type in the Power BI web application.

I would suggest updating the ASA query to explicitly cast the fields that you want to be numbers:

https://msdn.microsoft.com/en-us/library/azure/dn834995.aspx

https://msdn.microsoft.com/en-us/library/azure/dn835065.aspx

Once you cast the field, ASA should update the type in Power BI as part of outputting the field.

Let me know if that works!

Re: stream analytics as streaming dataset source

bjagpal — Thu, 20 Oct 2016 20:18:35 GMT

Yes, it worked perfectly. The revised ASA query is shown below. Can I be informed of the ASA streaming dataset private preview when it becomes available?

Thanks.

Select
CAST (timecreated AS datetime) as timecreated,
CAST (Out AS bigint) as Out,
CAST (Ex AS bigint) as Ex,
CAST (Rm AS bigint) as Rm,
Name
from devicesinput TIMESTAMP by timecreated

Re: stream analytics as streaming dataset source

sirui_sun — Sat, 29 Oct 2016 01:07:58 GMT

Of course. Please PM me with your e-mail address, and I will add you to the private preview list. When private preview begins, I will reach out with next steps.

Re: stream analytics as streaming dataset source

panzertax — Sun, 18 Dec 2016 11:11:21 GMT

When will this feature be released?

Can you add me to the preview as well?

Re: stream analytics as streaming dataset source

liey87 — Tue, 20 Dec 2016 03:12:57 GMT

I was shock when I see my data is arriving IoT Hub. The data is processing in ASA to Blob Storage though the output to PowerBi is not appear on "Dataset" panel.

Then, I saw it on "Streaming Datasets". And the dashboard was totally awesome for live data without specifying "SHOW IN THE LAST XX SECONDS" as incoming can be dynamic interval send from downstream. Totally perfect. And the things that I want so bad, is the line chart in window time. What a good dashboard view as Task Manager graph viewing without needed to see all the data from start until current (every hour is ok, every 5 seconds, nope, distort looks).

But last week, I creating another ASA output to PowerBi and see it sink back to normal "Dataset" panel. I was wondering what happen suddenly. Then, I read this article which stated "Private Preview".

We just show to customer what we did but we can't provided to them like what we did to our demo. Btw, when it will be release as an official ASA to PBi live streaming?

Re: stream analytics as streaming dataset source

liey87 — Wed, 28 Dec 2016 02:41:02 GMT

Hi sirui_sun,

I already PM you for joining the private preview list