Connecting REST API with user authentication + limit lines per request

[Holguinmora]

Hi

I´m trying to connect to the next API using Blank Query but it’s been more complex that I thought

On the next lines the API info:  

Method: GET Path: https://api.repsly.com/v3/export/clients/{lastTimestamp}

Accept: application/json, application/xml

Content-Type: application/json, application/xml

User: 804144F2-78E3-47DE-9CCB-9B226634CD91

Password: 3B5A34D3-AD6D-496E-9125-4CAD9F8FXXXX

In each call the Api sends 50 lines - data base is no less than 600 lines.

To get the first set of data I change the {lastTimestamp} for a 0 as the next example https://api.repsly.com/v3/export/clients/0 

On the next lines a short description on how I the Metadata must be implemented:

"In every response you will receive meta variable LastTimeStamp of the last changed record in the list. Save it for future requests so you can use it as a parameter {lastTimeStamp} for every subsequent request until the response meta variable TotalCount is equal to 0, which means you have received all updates.   To get the complete list of clients, start your request with parameter {lastTimeStamp} = 0.  

Any help will be more than apreciated!!!

[mattmasson]

Yes, this will be complex. My recommendation would be to create a custom connector that with paging logic, otherwise you'll likely run into issues around dynamic URL access when trying to configure scheduled refresh. 

The DataConnectors github repo has some getting started links, and an overview video that walks through the creation of a custom connector. I'd also recommend going through the TripPin tutorial - part 5 (Paging) will apply to the REST API you've described here.

[v-juanli-msft]

Hi @Holguinmora 

Do you want to avoid REST API limit or add limit per request?

Best Regards
Maggie

[Holguinmora]

Maggi hi

I need to get all the data from the REST API, the 50 lines limit per request is part of the API configuration that I can not change it

Any ideas?

[v-juanli-msft]

Hi @Holguinmora 

Is this thread helpful?

I have little experience with API, maybe there are some workarounds to import data to Power BI.

eg, store data in database like SQL Server, then connect to SQL Server with Power BI,

Use "Python" to get data from web, then use the python script in Power BI.

Best Regards
Maggie
Community Support Team _ Maggie Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.