Forum Discussion
How to load complete data set from pagination API Call
Hello I am trying to load my dataset from api. Records are saved in pagination formate. Data is loaded successfully but I am unable to work with all record set (700 rows, from 7 pages) its just loading records from 1 page and 100 rows. How can I get 100% records. Following is my query:
= Json.Document(Web.Contents("https://xyz.com?total_pages", [Headers=[#"key"="token=xyz", Xemail="[email protected]", #"Content-Type"="application/Json"]]))
Thanks,
Hassan
Hi Hassan,
Have a look at this thread I answered a while back to see if it can help you:
https://community.powerbi.com/t5/Power-Query/How-to-deal-with-paginated-API/m-p/3222229
The key is to find the total amount of records available in your endpoint, create a column separated into page size values up to the total number of records, then run the API query against each page row.
Pete
1 Reply
Hi Hassan,
Have a look at this thread I answered a while back to see if it can help you:
https://community.powerbi.com/t5/Power-Query/How-to-deal-with-paginated-API/m-p/3222229
The key is to find the total amount of records available in your endpoint, create a column separated into page size values up to the total number of records, then run the API query against each page row.
Pete