Looping Query to get all pages data through API

[Yash48]

Hi,

I have an API where there is no page/pagenumber option, but the url to query to access the second page is in the result of the first initial query. I can get the first page using this URL "https://data.api.kayrros.com/v3/lng/flaring/data". But I am not able to get data of next pages, as the next page URL is in the Meta data of the first URL endpoint.

Below is an example with an endpoint. In the answer, you have a "next" field in the "metadata" field. You must query this url to access the second page.

{'metadata': {'took': 154,

  'total': 171631,

  'next': 'https://data.api.kayrros.com/v3/lng/flaring/data?after=yamal_lng_6768'},

 'extractedData':

How do I loop the query to get all pages data? Could someone please help me with this?

Thank you,

Yash

[lbendlin]

There are lots of examples using List.Generate or List.Accumulate that show how to deal with paginated APIs. Looks like in your case List.Generate is more appropriate.