topic Copy Data via API - Looping through an input in Pipelines

Copy Data via API - Looping through an input

higgy7 — Thu, 20 Jun 2024 13:09:06 GMT

Hi,

I am quite new to pipelines and i am trying to copy data via an api using the lat and long from a table.

I can successfully copy data for one site using the parameters and url. However ideally i want it to run 25 times for 25 sets of lats and longs.

I had looked at using the lookup and a for each loop but I do not know how to put it all together. Any help would be greatly appreciated.

Re: Copy Data via API - Looping through an input

Anonymous — Fri, 21 Jun 2024 10:41:52 GMT

Hi higgy7 ,

Thanks for using Fabric Community.
Can you please refer below links to get some idea on how to use it -
08 Microsoft Fabric Data Pipeline: How to Use Lookup and Foreach Activity in Data Pipeline (youtube.com)
1.08-Building Iterative Logic in Microsoft Fabric Data Pipelines using ForEach Activity (youtube.com)

My suggestion:
1. Use Lookup activity to get the latitudes and longitudes by using a query.
2. After fetching the data, use For Loop to interate over the data
3. Use Copy Activity and create the logic that required.

Hope this is helpful. Please do let me know incase of further queries.

Re: Copy Data via API - Looping through an input

higgy7 — Fri, 21 Jun 2024 15:31:08 GMT

Thanks for this. The only piece i was missing was the syntax to bring in individual items from the lookup into items to use in the url. These videos showed this part in use.

Re: Copy Data via API - Looping through an input

Anonymous — Mon, 24 Jun 2024 07:41:42 GMT

Hi higgy7 ,

I hope your query was answered. Please continue using Fabric Community on your further queries.