- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Copy Data Pagination - Offset in Request Body
Hi all,
I am using the Copy Data activity to bring in a full data table into my bronze layer in Fabric. I am connecting to an API where the pagination method is using an offset in the request body. I can get the total number of pages (and therefore the max value of the offset figure and more) in the table easily using a POST call and a define variable activity. Additionally, each POST call returns the 'pages remaining' in the return body. What I need to know is can we paginate through the records using the Copy Data activity in the request body?
Let me know if I need to provide any further information.
Thanks,
Lewis
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Jameopw ,
If the API uses the offset in the request body for paging, you can implement the paging logic in the following ways:
Use the Define Variable activity to initialize the offset (e.g. offset = 0). Use the Until activity to loop through calls to the API until all page data has been fetched.
For more details, you can refer to below document:
Set Variable activity - Microsoft Fabric | Microsoft Learn
Until activity - Microsoft Fabric | Microsoft Learn
Best Regards,
Adamk Kong
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Jameopw ,
If the API uses the offset in the request body for paging, you can implement the paging logic in the following ways:
Use the Define Variable activity to initialize the offset (e.g. offset = 0). Use the Until activity to loop through calls to the API until all page data has been fetched.
For more details, you can refer to below document:
Set Variable activity - Microsoft Fabric | Microsoft Learn
Until activity - Microsoft Fabric | Microsoft Learn
Best Regards,
Adamk Kong
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources
Join us at the Microsoft Fabric Community Conference
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Fabric Monthly Update - February 2025
Check out the February 2025 Fabric update to learn about new features.

Subject | Author | Posted | |
---|---|---|---|
07-02-2024 11:53 AM | |||
02-26-2024 07:48 AM | |||
Anonymous
| 10-24-2024 04:05 AM | ||
Saturday | |||
12-27-2024 01:11 AM |
User | Count |
---|---|
8 | |
1 | |
1 | |
1 | |
1 |
User | Count |
---|---|
15 | |
5 | |
5 | |
3 |