Efficient paginated REST requests

[daveedd]

Hi all,

I'm performing a REST request against a paginated source.  I've pulled the number of pages, then used the List.Numbers to create a table with rows = the number of pages, and added a custom column with the query for each page.  The method is working but breaks for some of the larger tables.

Looking for advice on the most efficient way to do the paginated pulls, I'm worried that the list method is sending all the queries at the same time which is causing the issue.

Any advice would be appreciated thanks

[amitchandak]

@daveedd , refer if these two can help

https://datachant.com/2016/06/27/cursor-based-pagination-power-query/

https://medium.com/@marktiedemann/how-to-do-pagination-in-power-query-430460c17c78