Paginated rest api, tricky end conditions

[oysteing]

Hi,
I'm trying to pull data from a rest api, the api is paginated with two urls, one to itself (meaning the page I've just recieved), and one to the next page. So far so good, I can input the link to the next page and get more data. But eventually I reach the last page, and I'd expect the link to the next page to be empty, but no. To identify that it's the last page the rule is (from the documentation): "The current last page on a list allowing incremental update, is identified by the nextPage and self being the same value"

Anybody know how to create a rule for that end condition i data factory? As far as I can tell, I can't compare two json values to each other in the EndCondition part for a Rest source...

Any input is appreciated
Thanks

[oysteing]

Hi,

the question is about a pipeline in Azure Data Factory, I'm unable to set any stop condition that works for the api in the copy data step

[v-cboorla-msft]

Hi @oysteing 

Apologies for the inconvenience, this community is specifically for discussions and questions related to Microsoft Fabric. For queries related to Azure Data Factory (ADF), we recommend using the dedicated Microsoft Q&A forum where they are ready to assist you better. Here's the link to post your query in Microsoft Q&A : Ask a question - Microsoft Q&A.

Thanks.

[v-cboorla-msft]

Hi @oysteing 

Thanks for using Microsoft Fabric Community.

Could you please clarify whether this pertains to a pipeline within Azure Data Factory (ADF) or a pipeline within Microsoft Fabric?