REST API pagination & filtering

[Anonymous]

Hi everybody,

It's my first time using a REST API as a data source and this is my situation:

1. Pagination: I've figured out how to use a parameter to loop through pages since each page allows only 500 rows. I've followed this blog https://adatis.co.uk/Loop-through-Multiple-Web-Pages-using-Power-Query/ and the pagination works pretty good. The only challenge now is that I need to have a dynamic table that has the right number of pages (maybe counting my records?) instead of what I have right which is a fixed number of pages.

2. Power BI limitation of importing 10,000 rows from an API call for Pro Users. I need to import around 250,000 rows and I'm trying to filter my data source on the query script so I can use multiple calls with less than 10,000 records each , for example:  https://source.com/api/v4/orders?carrier_name=fedex&per_page=500&page=
But the result does not change...Is it something that my developer has to give me permission to use as a filter? The parameters that I'm using are actual columns on my API so I'm not sure why it does not work. Is there another way of doing this?

Thank you! 

[mwegener]

Hi @Anonymous ,

where did you find the limitation of importing 10,000 rows from an API call?

Regards,

Marcus

Dortmund - Germany
If I answered your question, please mark my post as solution, this will also help others.
Please give Kudos for support.

[Anonymous]

Here is the documentation:

https://docs.microsoft.com/en-us/power-bi/developer/api-rest-api-limitations

[mwegener]

Hi @Anonymous ,

this limitations are for the Power BI Service Rest API not for other "Source" Rest APIs.

Regards,

Marcus

Dortmund - Germany
If I answered your question, please mark my post as solution, this will also help others.
Please give Kudos for support.

[Anonymous]

Hi Marcus,

Do you mean that if I'm using other source Rest API I should be able to retrieve more than 10,000 rows?

But when I try doing it the result is limited to 10,000 even though my table has over 20,000 rows. Do you what could be happening?

Thanks!

[mwegener]

Hi @Anonymous,

is your problem solved?
If I answered your question, please mark my post as solution, this will also help others.
Please give Kudos for support.

[mwegener]

Hi @Anonymous ,

yes I think so.

Maybe your source has limited itself.

Is there documentation for the service / interface?

Have you already tested the response with another client (browser).

Regards,

Marcus

Dortmund - Germany
If I answered your question, please mark my post as solution, this will also help others.
Please give Kudos for support.