Forum Discussion

inoitunoit's avatar
inoitunoit
Regular Visitor
9 years ago

Reddit Karma Dashboard

Hi All,

 

I thought you would be interested in this: http://meirl.azurewebsites.net/

 

This is a dashboard which displays the cumulative karma score for posts on reddit.com which, for those unfamiliar, is a bunch of public forums (subreddits) where uses vote on people's posts - pictures, links, thoughts etc. The purpose of the dashboard is to gain insight into trending and popular topics and images.

 

I started this as an exploration of the Azure platform - and I have to say, I'm very impressed. Within an hour I had deployed a database and a task to routinely fetch new data - all with just 1 block of actual "code" (a stored procedure to insert new records into the database). The rest was done entirely within the Azure platform and the UI - even putting together the final web page was done in the browser. The only additional software required was Power BI Desktop to develop the reports, and a small executable to publish them (which hopefully will become a bit more abstract and elegant in the future). I had the database, ETL and reports up and running for I reckon less than $5 Azure costs. On top of that, the machine learning studio has allowed me to put together predictive models, so rather than just looking at the data on pretty charts, the system can begin to predict what will be popular in the future. Exciting times we are living in! :)

 

Anyway, I'm really interested in your thoughts and feedback on the reporting - any ideas, suggestions improvements etc...? Layout changes? More views? I also just thought it was a pretty cool demo of embedded Power BI reports :)

Show and Tell

2 Replies

  • v-qiuyu-msft's avatar
    v-qiuyu-msft
    Community Support
    9 years ago

    Hi inoitunoit,

     

    You can see on report page "48 Hour Subreddit Bubbles", the scatter contains too many values, it would be better to add a filter for this visual.

     

    Best Regards,
    Qiuyun Yu

    • inoitunoit's avatar
      inoitunoit
      Regular Visitor
      9 years ago

      Hi Qiuyun_Yu

       

      Thanks for the feedback :) I had noticed that popping up occassionally. Do you think that when that occurs you should always take steps to ensure it doesn't, or do you think in some cases it is OK, as long as the user is made aware?

       

      Is there a bias towards displaying the outliers first, with the missing values being part of the clusters? So effectively, even though the values may be missing, it shouldn't matter because they would be buried under the cluster? That may make it acceptable for this message to appear?

       

      If you filter these values out at the report or page level, you risk some of the other visualisations suffering - perhaps there will be some values missing from an aggregate. Applying a filter directly to the visualisation may mean those elements can never be highlighted on the visualisation if you were to filter the report by clicking another visualisation's aggregate element. However, if you allow the system to hide them, it should still be able to present the data when needed - ie when the dataset is reduced by applying some other filter.

       

      I'm not trying to be argumentative :) I think sometimes it's not always so clear whether it's OK for something like this to occur, and I'm interested in others opinions and experiences.

       

       

      Edit - Ahah! Upon further investigation I found this case was caused by reddit sending more data than was requested. It happened at 11:00pm on the 25th October. When requesting data from reddit the default return count is 25, but in this instance it has returned 102 records (I checked the json response from reddit). So you'll notice that some posts suddently re-appear. Naughty reddit! Not much I can do about this either, aside from building a limiter in the insert procedure. But really, it's a bug on reddit's end.