cancel
Showing results for 
Search instead for 
Did you mean: 

Fabric is Generally Available. Browse Fabric Presentations. Work towards your Fabric certification with the Cloud Skills Challenge.

Reply
rossgh
Microsoft
Microsoft

Twitter streaming analytics - step-by-step

Hi guys,

 

I wanted to setup a simple stream analytics stream that I can capture (OutPut) in PowerBI.

There are instructions on how to set parts of it up, but not a complete end-to-end tutorial.

Does this require any type of coding in VS?

 

Thanks for your time and advice :).

1 ACCEPTED SOLUTION
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

View solution in original post

1 REPLY 1
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

Helpful resources

Announcements
PBI November 2023 Update Carousel

Power BI Monthly Update - November 2023

Check out the November 2023 Power BI update to learn about new features.

Power BI Fabric Summit Carousel

The largest Power BI and Fabric virtual conference

130+ sessions, 130+ speakers, Product managers, MVPs, and experts. All about Power BI and Fabric. Attend online or watch the recordings.

Top Solution Authors