topic Isolated variable inside loop iteration in Data Engineering

Isolated variable inside loop iteration

amaaiia — Tue, 21 May 2024 13:13:17 GMT

Is there a way to have a variable that is only affected by one iteration within a loop activity? I mean, I have a variable var1 and it is updated within a loop, but I want that variable to affect only the particular iteration. That is, if I run 3 iterations at the same time, as all iterations modify the same variable var1, their values are overlapping. However, what I need is an isolated variable in each iteration. Is this possible?

Re: Isolated variable inside loop iteration

Anonymous — Wed, 22 May 2024 06:44:50 GMT

Hi @amaaiia
Thanks for using Fabric Community.
Data Factory pipelines don't directly support loop-specific variables. However, you can try this:

Use Set Variable Activity:

Inside your loop, include a "Set Variable" activity before your logic that modifies the original var1.
Within the "Set Variable" activity, define a new variable specific to the iteration.
Modify this newly created variable within the loop.

This might be helpful in your case. You can refer to this link for more help:
How to create iteration scoped variables inside ForEach activities in Azure Data Factory - Stack Overflow

Hope this helps. Please let me know if you have any further questions.

Re: Isolated variable inside loop iteration

amaaiia — Wed, 22 May 2024 07:43:41 GMT

Hi @Anonymous

I don't understand. If I define new variable inside loop, imagine var2, var2 will be updated in each iteration too.

Re: Isolated variable inside loop iteration

Anonymous — Wed, 22 May 2024 08:18:17 GMT

Hi @amaaiia
Data Factory pipelines don't directly support loop-specific variables.