Forum Discussion

Asynchronism's avatar
Asynchronism
Frequent Visitor
6 years ago
Solved

Looping - API Call

Hi All,

 

I have an api call that only returns 50 results at a time, and I need to run it multiple times to build my result table.

 

Example:  myapi/getlist?limit=50&page=1   where page 1 is results 1-50, page 2 is results 51-100, etc.

 

How can make multiuple calls, updating page to page+1 each time, ultimately building one result table?  The reading I've done on looping hasn't gotten me very far.  Thanks!  Dave

Need Help

5 Replies

    • Asynchronism's avatar
      Asynchronism
      Frequent Visitor
      6 years ago

      That sure looks like what I'm after, thank you.  Might have some follow up questions as I get into it!

    • Asynchronism's avatar
      Asynchronism
      Frequent Visitor
      6 years ago

      ImkeF  - got it working, thank you.  Ended up doing it by records, not pages, but basically the same result

       

      Here's what I ended up with:

       

      url = "myapi/getlist?&limit=50&offset=0",

      Source = ((Web.Contents(url, [Headers=[#"Content-Type"="application/json"]]))),

       

      #"Imported JSON" = Json.Document(Source,65001),

      Custom1 = List.Generate( () =>
           [Result = #"Imported JSON", Offset = 0],
           each [Result][response][count] > ([Offset]),   //api returns a total record count as "count" in the response section
           each [
                Result = Json.Document(Web.Contents(url & "&offset=" & Text.From([Offset] + 50) )),
           Offset = [Offset] + 50
           ]

      ),

      • Ricardo_MSS's avatar
        Ricardo_MSS
        Helper II
        5 years ago

        Hi ImkeF, 

         

        I've noticed you seem to be the go to person for looping API calls, was hoping you could go over my code and see where I'm going wrong. 

         

        This is what I've currently have - 

         

        let
        ProjectID = "135353", // Type Dalux ProjectID
        iterations = 20,
        Bookmark1 = "0",
        url = "https://field.dalux.com/service/APIv2/FieldRestService.svc/v2.2/Projects/" &
        ProjectID &
        "/Approvals?key=[API KEY]&bookmark=",


        FnGetOnePage=
        (url, Bookmark1) as record =>
        let
        Source = Json.Document(Web.Contents(url & Bookmark1)),
        data = try Source[ApprovalsList] otherwise null,
        next = try Source[NextBookmark] otherwise null,
        res = [Data = data, Next = next]
        in
        res,


        GeneratedList =
        List.Generate(
        () => [i=0, res = FnGetOnePage(url, Bookmark1)],
        each [i] < iterations and [res][Data] <> null,
        each [i=[i]+1, res = try FnGetOnePage(url & [res][Next]) otherwise null],
        each [res]
        )
        in
        GeneratedList

         

        The image below is the result of the query:

         

         

         The function is working and is able to call the first batch of results but then it fails to replace Bookmark1 for the Next cursor and terminates the list. 

         

        Any suggestions?

         

        Thank you in advanced. 

         

        Best regards, 

         

        Ricardo.