How to load complete data set from pagination API Call

[HassanMoosa]

Hello I am trying to load my dataset from api.  Records are saved in pagination formate.  Data is loaded successfully but I am unable to work with all record set (700 rows, from 7 pages) its just loading records from 1 page and 100 rows.  How can I get 100% records. Following is my query:

= Json.Document(Web.Contents("https://xyz.com?total_pages", [Headers=[#"key"="token=xyz", Xemail="xyz@gmail.com", #"Content-Type"="application/Json"]]))

Thanks,

Hassan

[BA_Pete · Accepted solution]

Hi Hassan,

Have a look at this thread I answered a while back to see if it can help you:

https://community.powerbi.com/t5/Power-Query/How-to-deal-with-paginated-API/m-p/3222229 

The key is to find the total amount of records available in your endpoint, create a column separated into page size values up to the total number of records, then run the API query against each page row.

Pete