cancel
Showing results for 
Search instead for 
Did you mean: 

Fabric is Generally Available. Browse Fabric Presentations. Work towards your Fabric certification with the Cloud Skills Challenge.

Reply
rossgh
Microsoft
Microsoft

Twitter streaming analytics - step-by-step

Hi guys,

 

I wanted to setup a simple stream analytics stream that I can capture (OutPut) in PowerBI.

There are instructions on how to set parts of it up, but not a complete end-to-end tutorial.

Does this require any type of coding in VS?

 

Thanks for your time and advice :).

1 ACCEPTED SOLUTION
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

View solution in original post

1 REPLY 1
konstantinos
Memorable Member
Memorable Member

Unfortunately I haven't found a steb by step for no coders ( I don't know Json or even use VS except SSDT )..

 

I had played around and searching for a couple of days to make work. I am sure this is not the best solution or even correct ( at least it works ) as also using the best avaliable azure resources  for the data workflow.

 

But at least for a no coder like me it was the only option I manage to make it work and seemed easier to follow.

I am planning to write an analytical blog post but until I found some time and optimize the set up, this is a summary of what I did.

 

I used Azure Logic apps to send tweets to an event hub and then used an Stream Analytics job to read from event hub and send them to PowerBI.

 

 

Create a Logic app and use the default twitter connector as trigger  ( plus the neccessary resource group, app plan etc. )  

 

https://azure.microsoft.com/en-us/documentation/articles/app-service-logic-create-a-logic-app/

This link also has other link on how to create the twitter app in Twitter Dev

 

Create an event hub

https://azure.microsoft.com/en-us/documentation/articles/event-hubs-csharp-ephcs-getstarted/

I didn't use VS since I only add endpoints

 

Deploy the event hub connector from Github

https://github.com/logicappsio/EventHubAPI

 

Add Twitter & EventHubAPI to Logic app workflow

 

 

Set up Stream Analytics Job

https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-get-started/

 

 

A quick post that has all combined and unfortunately I found it after tried many other things

http://blogs.msdn.com/b/logicapps/archive/2015/09/23/adding-insights-and-telemetry-to-logic-apps-thr...

 

Hope it can help you start from somewhere.

I am also hoping many have designed it better and easier..Looking forward to their opinion

 

Konstantinos Ioannou

Helpful resources

Announcements
PBI November 2023 Update Carousel

Power BI Monthly Update - November 2023

Check out the November 2023 Power BI update to learn about new features.

Community News

Fabric Community News unified experience

Read the latest Fabric Community announcements, including updates on Power BI, Synapse, Data Factory and Data Activator.

Power BI Fabric Summit Carousel

The largest Power BI and Fabric virtual conference

130+ sessions, 130+ speakers, Product managers, MVPs, and experts. All about Power BI and Fabric. Attend online or watch the recordings.

Top Solution Authors
Top Kudoed Authors