Forum Discussion

jrobertosm's avatar
jrobertosm
Frequent Visitor
5 years ago
Solved

Extract data from an API paginated??

I need to extract data from an API paginated.

The item limit per page is 50.

There are 15,000 items to be extracted.

I can connect with the API and retrieve the first 50 items.

How can I recursively extract all the data? Create a single table with all 15,000 items ...

---

Code:

let
token = Number.ToText(123456),
take = Number.ToText(50),
skip = Number.ToText(0),
url = "https://conectapi.com/v1/authenticate",
body = "{""username"":""[email protected]"",""password"":""123456"",""myid"":""123"",""Expires"":""30""}",
Parsed_JSON = Json.Document(body,65001),
BuildQueryString = Uri.BuildQueryString(Parsed_JSON),
Source = Json.Document(Web.Contents(url,[Headers = [#"Content-Type"="application/json"], Content = Text.ToBinary(body) ] )),
#"Convertido em Tabela" = Record.ToTable(Source),
#"Linhas FiltrImageadas" = Table.SelectRows(#"Convertido em Tabela", each ([Name] = "Token")),
#"Personalizado Adicionado" = Table.AddColumn(#"Linhas Filtradas", "URL_Apol_Cia", each "https://conectapi.com/v1/"&[Value]&"/Documents?take="&take&"&skip="&skip),
URL_Docs_Cia = #"Personalizado Adicionado"{0}[URL_Apol_Cia],
OrigemDocsCia = Json.Document(Web.Contents(URL_Apol_Cia,[Timeout=#duration(0,0,30,0)]))
in
OrigemDocsCia

---

Image query result:

3 Replies