Forum Discussion
Bokazoit
1 year agoContinued Contributor
Handle "large" amount of data using API and incremental refresh
I write "large" because the intial load is 3.5 mio rows, and that is imho not large. But my problem is this: It is Business Central and I fetch data using API. I would like to use incremental...
Greg_Deckler
1 year agoCommunity Champion
Bokazoit Set it up as you have with the intial load and no refresh. Hard code the date after the initial load into a second query. Merge the queries, don't worry about incremental refresh and just let the 2nd query refresh everything. A few months from now or so, hard code an end date for the 2nd query and setup a 3rd query and rinse and repeat. Not glamorous but should work. Other option is to open a support ticket with Microsoft and find out why incremental refresh is failing.
Bokazoit
1 year agoContinued Contributor
Thx, but it is done using system modified, so a date in the initial load may be altered...So it is not a valid path to follow