Hello together,
my problem is that for the incremental period rows are saved multiple times and therefore wrong results are displayed in the dashboard.
The multiple rows occur only in the incremental period (on daily basis, the last 13 days), in the periods in which the last months are saved/loaded the row counts and results are correct.
First of all about the setup, because I use the incremental refresh a little bit different.
I have csv report files in a sharepoint folder which are uploaded multiple times daily. In these are always orders across days, which gradually get different statuses and delivery dates.
In order not to load and analyze all files every day, I have written a function that reads the latest file of a day, by date and time.
For the incremental update, there is another query in which a table with all the dates to be updated are listed and then execute the previously described function and thus a table with all the desired data is created.
My date filter looks like this: "... , each [DateTime] >= RangeStart and [DateTime] < RangeEnd)"
Tried buffering, ordering and removing duplicates in the query after loading all the reports in the date table, but that does nothing.
I also tried to create a new table from the query table, where all rows are checked for duplicates, also nothing.
I can't explain why the rows in the incremental period are not summarized.
Has anyone perhaps had a similar problem? Or any idea what it could be/what else I can't try?
Thanks already!
