Forum Discussion
How to collect data from different sources dynamically using foreach loop activity
- Anonymous1 year ago
Hi RajuArge
You can dynamically create datasets and perform join or merge operations using ForEach activities. The general steps are as follows:
Create a ForEach activity that traverses an array containing information about the data sources.
Inside the ForEach loop, you can use activities such as Copy Data to extract data from each source and store it in a temporary dataset.
At the end of the ForEach loop, use the Data Flow activity to join the two datasets.
Store the joined dataset in the target location.
ForEach activity - Microsoft Fabric | Microsoft Learn
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi RajuArge
You can dynamically create datasets and perform join or merge operations using ForEach activities. The general steps are as follows:
Create a ForEach activity that traverses an array containing information about the data sources.
Inside the ForEach loop, you can use activities such as Copy Data to extract data from each source and store it in a temporary dataset.
At the end of the ForEach loop, use the Data Flow activity to join the two datasets.
Store the joined dataset in the target location.
ForEach activity - Microsoft Fabric | Microsoft Learn
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi Nono Chen,
Thank you so much for quick reply. API is also one of my data source so , how we pull data from API efficiently iteratively. Can you please help me out with this?