Forum Discussion

cdupland's avatar
cdupland
Frequent Visitor
8 years ago

Stream Analytics - Update row in dataset

Hello,

 

I am using an Azure architecture to have a real-time Dashboard Power BI about Twitter post.

 

Architecture is like this : Event Hub -> Streaming Analytics -> Power BI

This works fine and I can show Tweets and statistics moce in real-time.

 

My problem is that Stream Analytics can only add row in my Dataset and it's possible to receive same tweet from my Event Hub.

So I potentially add several times the same Tweet in my Dataset and distort data statistics.

 

I would like to know if it's possible to do an update with Stream Analytics in the Dataset, or if there is a trick to get the most recent post when there is a duplication ?

 

 

Thanks.

Cyril

5 Replies

    • cdupland's avatar
      cdupland
      Frequent Visitor

      Hi Dale,

       

      Main visual in Power BI are counting rows (distcint), list, bargraph with date, circular, etc..

      I don"t know how to get the most recent row between 2.

       

      Thanks

      Cyril

      • v-jiascu-msft's avatar
        v-jiascu-msft
        Microsoft Employee

        Hi Cyril,

         

        How can we identify the "2"? By date?

        Do you mean this scenario below?

         

        row1  news1  date1

        row2  news1  date1

        row3  news2  date2

         

        Since the row1 and row2 are the same, you need to show up the row1 and row3.

         

        Best Regards,

        Dale