twitter entity analysis

Question

Hi All,&nbsp;I would like a method to import the entities and types in my power bi dataset with tweets similar to this sentiment model in:&nbsp;http://nisalbi.blogspot.com/2017/10/step-by-step-twitter-sentiment-analysis.html&nbsp;This is the resultset from this method but I can't be sure how to import this and put this in a list of most common Persons or organisations within Power BI (https://docs.microsoft.com/en-gb/connectors/cognitiveservicestextanalytics/#EntitiesResult)&nbsp;&nbsp;Here is the resulset from a recent politician's tweet. How would I process this into PowerBI for an indeterminate number of Entities?[&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;"id":&nbsp;"2020-05-30T10:24:57.000Z",&nbsp;&nbsp;&nbsp;&nbsp;"entities":&nbsp;[&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"name":&nbsp;"AOC",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"matches":&nbsp;[&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"entityTypeScore":&nbsp;0.8878183960914612,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"text":&nbsp;"AOC",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"offset":&nbsp;1,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"length":&nbsp;3&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;],&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"type":&nbsp;"Organization"&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;},&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"name":&nbsp;"Riot",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"matches":&nbsp;[&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"wikipediaScore":&nbsp;0.207984138670666,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"entityTypeScore":&nbsp;0.8,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"text":&nbsp;"Rioting",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"offset":&nbsp;48,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"length":&nbsp;7&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;],&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"wikipediaLanguage":&nbsp;"en",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"wikipediaId":&nbsp;"Riot",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"wikipediaUrl":&nbsp;"https://en.wikipedia.org/wiki/Riot",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"bingId":&nbsp;"edfc8233-01bd-45cf-0878-a66dec3ddc51",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"type":&nbsp;"Other"&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;},&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"name":&nbsp;"George&nbsp;Floyd",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"matches":&nbsp;[&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"entityTypeScore":&nbsp;0.966582179069519,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"text":&nbsp;"George&nbsp;Floyd",&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"offset":&nbsp;165,&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"length":&nbsp;12&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;],&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"type":&nbsp;"Person"&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}&nbsp;&nbsp;&nbsp;&nbsp;]&nbsp;&nbsp;}]&nbsp;How can I go about this with a power apps flow + power bi streaming dataset?&nbsp;

v-easonf-msft · Answer

Hi ,&nbsp;treeofwisdom100&nbsp;It seems that only&nbsp; one entity&nbsp;in the streaming dataset is supported by design.It is recommended to create a streaming data set for each entity.&nbsp;BTY,you&nbsp; can also&nbsp; &nbsp;use web data source to call Twitter API and do the data cleaning in Query Editor&nbsp;.Please refer to these related posts and video.https://chris.koester.io/index.php/2015/07/16/get-data-from-twitter-api-with-power-query/https://www.youtube.com/watch?v=i88CBli0uQc&nbsp;Best Regards,Community Support Team _ Eason

v-easonf-msft · Answer

Hi,&nbsp;treeofwisdom100&nbsp;Could you please tell me whether your problem has been solved?If it is,&nbsp; please mark the helpful replies or add your reply as Answered to close this thread.It will help other community members easily find the solution when they get the similar issue.Best Regards,Community Support Team _ EasonIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Forum Discussion

twitter entity analysis

2 Replies

Related content

Cohort analysis

Twitter Analysis with Power BI

Retention analysis

A Typo in the Entity’s property value type (Korean)

Spark sessions for entity resolution