topic Re: Stream Analytics - Update row in dataset in Developer

Stream Analytics - Update row in dataset

cdupland — Mon, 09 Jul 2018 08:23:11 GMT

Hello,

I am using an Azure architecture to have a real-time Dashboard Power BI about Twitter post.

Architecture is like this : Event Hub -> Streaming Analytics -> Power BI

This works fine and I can show Tweets and statistics moce in real-time.

My problem is that Stream Analytics can only add row in my Dataset and it's possible to receive same tweet from my Event Hub.

So I potentially add several times the same Tweet in my Dataset and distort data statistics.

I would like to know if it's possible to do an update with Stream Analytics in the Dataset, or if there is a trick to get the most recent post when there is a duplication ?

Thanks.

Cyril

Re: Stream Analytics - Update row in dataset

v-jiascu-msft — Tue, 10 Jul 2018 05:52:24 GMT

Hi Cyril,

If they are duplicates, they all could be the most recent. Maybe you can filter them in the beginning. Which visual did you use in the Power BI? Maybe we can filter them using a slicer. About filtering push dataset, please refer to service-real-time-streaming#can-i-use-filters-on-push-dataset-how-about-streaming-dataset.

Best Regards,

Dale

Re: Stream Analytics - Update row in dataset

cdupland — Fri, 13 Jul 2018 07:51:29 GMT

Hi Dale,

Main visual in Power BI are counting rows (distcint), list, bargraph with date, circular, etc..

I don"t know how to get the most recent row between 2.

Thanks

Cyril

Re: Stream Analytics - Update row in dataset

v-jiascu-msft — Fri, 13 Jul 2018 08:07:46 GMT

Hi Cyril,

How can we identify the "2"? By date?

Do you mean this scenario below?

row1 news1 date1

row2 news1 date1

row3 news2 date2

Since the row1 and row2 are the same, you need to show up the row1 and row3.

Best Regards,

Dale

Re: Stream Analytics - Update row in dataset

cdupland — Wed, 18 Jul 2018 17:16:11 GMT

Hi Dale,

My scenario is below :

row1 news1 date1

row2 news1 date2

row3 news2 date1

Row1 and row2 are the same, with date2 > date1.

So, I would like to show row2 and row3.

Thanks

Best Regards

Cyril

Re: Stream Analytics - Update row in dataset

Roberto81 — Thu, 11 Mar 2021 08:58:36 GMT

Hi @cdupland

Did you solve this issue, I'm struggling with the exact same..

Roberto