Has anyone ever had issues with a paginated web API not pulling all available columns?
The company providing the data/API has confirmed the data is there, and I can also see it in the front end of the system.
Here is their documentation for this particular endpoint:
https://developers.samsara.com/reference/listdrivers
I used the same Advanced Editor query for all of the API endpoints.
let
url = "https://api.samsara.com/fleet/drivers",
Token = "#########################",
headers = [Headers=[ #"Authorization" = "Bearer " & Token ]],
FetchPage =
(url) as record =>
let
Source = Json.Document(Web.Contents(url,headers)),
data = try Source[data] otherwise null,
nextCursor = try if Source[pagination][endCursor] = "" then "DONE" else Source[pagination][endCursor] otherwise null,
res = [Data=data, NextPage=nextCursor]
in
res,
Drivers =
List.Combine(List.Generate(
()=>[res = FetchPage(url)],
each [res][NextPage]<> null,
each [res = FetchPage(url & "?after=" & [res][NextPage])],
each [res][Data]))
in
Drivers
Does anyone know why some of the columns wouldn't be showing up?
