Forum Discussion
Solved
Paginated REST API - Reduce number of requests and handling updated data
Hi everyone, I am using a REST API with a paginated method to retreive data from a system handling all the loading/unloading activity at a wharehouse. The pagination is working fine, I am also a...
Incremental refresh won't help you with that as the partition ranges are managed automatically by the service. You can only choose between day, month, quarter or year.
I would instead use an external storage.
That's a great challenge.
You will have to decide if you are only interested in the latest status for each visitor/truck, or if you are interested in the status change history as well.
For the former option you use an anti join (all the rows from the "updated" table plus all non-matching rows from the other table/self reference). For the latter option you would have to consult Nyquist/Shannon and then create your own storage solution with the change tracker.