Automated Pipeline Activity: Scheduling Dataset Requests via API

To get everything in a single row, you can do the following inside your second Foreach loop (the one calling /refreshes?$top=1):

1. After the Web activity, add a Set Variable or Append Variable activity.
2. In that activity, construct a JSON object like this:

{
  "id": "@{item().id}",
  "name": "@{item().name}",
  "refreshType": "@{activity('YourWebActivityName').output.value[0].refreshType}",
  "endTime": "@{activity('YourWebActivityName').output.value[0].endTime}",
  "status": "@{activity('YourWebActivityName').output.value[0].status}"
}

1. Append this object to an array variable.
2. At the end of the pipeline, you can write this array to a data warehouse using a Copy activity or Stored Procedure.

⚠️ Make sure to handle cases where value[0] might be null (e.g., no refresh history yet) to avoid runtime errors.

Let me know if you want help with the full pipeline JSON or error handling logic.

If my response resolved your query, kindly mark it as the Accepted Solution to assist others. Additionally, I would be grateful for a 'Kudos' if you found my response helpful.