Real Time data to keep only latest version of each record

Hi Herbert,

the data is not groupped by datatime, it's groupped by a custom key (RecordKey in the example below).

Example input data into stream analytics

Time         RecordKey   RecordValue

T                      r1                  10

T                      r2                  11

T+1                 r1                   12

T+2                 r1                   13

T+3                 r2                   14

T+4                 r1                   15

Lets assume this is how data arrives to stream analytics. For rows with same time, the records arrive together in an array.

The requirement is at any time to show latest 'RecordValue' for each 'RecordKey' in PowerBI, in real time

Expected values displayed in PowerBI

Time     Values

T           r1: 10, r2: 11

T+1      r1: 12, r2: 11

T+2      r1:13,  r2: 11

T+3      r1: 13, r2: 14

T+4      r1: 15, r2: 14

Can time window in stream analytics solve this problem, and keep data coming real time?

E.g. configuring a 'day' time window in stream analytics - is this going to calculte the aggregated view for all records for each update (T, T+1, T+2,...) and send to PowerBI? That would suggest stream analytics holds all the records throughout the time window.

Can we then configure PowerBI to always only display the latest records? 

Thanks,

Stefan