Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
AmandaMulryan
Frequent Visitor

Web API not pulling all columns

Has anyone ever had issues with a paginated web API not pulling all available columns? 

 

The company providing the data/API has confirmed the data is there, and I can also see it in the front end of the system. 

Here is their documentation for this particular endpoint: 

https://developers.samsara.com/reference/listdrivers 

 

I used the same Advanced Editor query for all of the API endpoints. 

 

let
url = "https://api.samsara.com/fleet/drivers",
Token = "#########################",
headers = [Headers=[ #"Authorization" = "Bearer " & Token ]],

FetchPage =
(url) as record =>
let
Source = Json.Document(Web.Contents(url,headers)),
data = try Source[data] otherwise null,
nextCursor = try if Source[pagination][endCursor] = "" then "DONE" else Source[pagination][endCursor] otherwise null,
res = [Data=data, NextPage=nextCursor]
in
res,

Drivers =
List.Combine(List.Generate(
()=>[res = FetchPage(url)],
each [res][NextPage]<> null,
each [res = FetchPage(url & "?after=" & [res][NextPage])],
each [res][Data]))
in
Drivers

 

 

Does anyone know why some of the columns wouldn't be showing up? 

1 REPLY 1
v-stephen-msft
Community Support
Community Support

Hi @AmandaMulryan ,

 

You can refer to these documents and check if they can help:

Handling paging for Power Query connectors - Power Query | Microsoft Docs

powerbi - Paging REST API results in Power Query - Stack Overflow

powerbi - How to get paginated data from API in Power BI - Stack Overflow

How to do Pagination on a REST API in Power Query (Part 1) - YouTube

 

 

Best Regards,

Stephen Tao

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors