Forum Discussion

uselessai_in's avatar
uselessai_in
Icon for Helper II rankHelper II
1 year ago
Solved

Parallel Processing with For-Each Activity in Fabric - Fabric Data Factory Pipeline

Hi all, I recently faced an issue with parallel processing when using for each loop with set variable activity.   The issue was "Set Variable" activity forces you to do processing sequentially, whi...
  • v-pnaroju-msft's avatar
    1 year ago

    Hi uselessai_in,

    We appreciate your inquiry on the Microsoft Fabric Community Forum.

     

    Thank you for sharing your solution. Kindly find below an alternative approach for parallel processing in Fabric’s Data Factory:

    You may utilise the Copy Activity with the parallelCopies property to copy multiple files simultaneously.

    For further reference, please find the following links:
    How to copy data using copy activity - Microsoft Fabric | Microsoft Learn
    Activity overview - Microsoft Fabric | Microsoft Learn

     

    If you find this response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members who may have similar queries.

     

    Thank you.