Forum Discussion
incorrect rowcounts when using flow and streaming data
Hi wilson_smyth,
I'd like to suggest you pause your flow and try again, it is hard to ensure the calculation of history data of live streaming dataset.
BTW, it also appears on other calculation(first,last) which other users mentioned but I can't reproduce.
Regards,
Xiaoxin Sheng
Hi.
thanks, but that doesnt solve the issue.
Its down to the fact that teh "RealTimeData" table needs the historic flag set to true in order to store data, and the flow is adding all records from the table each time. the "realTimeData" table is getting the same dataset over and over.
I have since learned that i need to access the powerbi API and empty the dataset.
theres a demo of how to do this here, by Konstantinos Ioannou which explains it fantastically. Its a lot of effort however, when the flow shape could simply have a check box that says "empty dataset before adding rows" or something similar.