Enhancing Data Factory: Support for Nested ForEach Loops and Conditional Logic
Currently, in Data Factory, the ForEach activity does not support nesting, meaning you cannot place one ForEach loop inside another. This limitation makes it difficult to process complex, hierarchical data structures where an outer loop needs to iterate over a set of items, and an inner loop should perform additional processing for each item. Allowing nested ForEach loops would enable more flexible and scalable workflows, eliminating the need for workarounds like using multiple pipelines or flattening data before processing.
Additionally, conditional logic inside ForEach loops is another missing capability. Right now, if you need to execute certain logic only when a condition is met inside a loop, you must create separate activities outside the loop or use multiple pipelines. Enabling If activities inside ForEach loops or allowing ForEach loops inside If activities would improve efficiency by allowing more dynamic decision-making without extra pipelines or unnecessary complexity.
These enhancements would provide greater flexibility, reduce pipeline fragmentation, and simplify workflow design.
Recent ideas
Reintroduce Tenant/Capacity Switch to Control "Users can create Plan items" Post-GA
During the Preview phase of Fabric Plan items, administrators had access to a dedicated tenant/capacity setting: "Users can create Plan items". With General Availability (GA), this granular administr...Sri-Surendra_Ku1 hour agoNew MemberNew97Views13likes1CommentSupport Fabric SQL Database with workspace-level inbound Private Link
Fabric SQL Database supports tenant-level Private Link but not workspace-level Private Link. Securing a small number of databases therefore requires enabling Private Link across the entire tenant, in...WorkFull223 hours agoAdvocate INew8Views1like0CommentsImprove Relationship UI Wording to Better Reflect Filter Propagation Direction
The current relationship dialog can be confusing because the UI labels "From" and "To" do not always align with users' linguistic expectations regarding filter propagation. As per document : Relation...v-varunvv3 hours agoMicrosoft EmployeeNew14Views4likes0CommentsDynamic ADLS-Gen2 path input for Spark Jobs Main definition file
I would like the ability to add a dynamic input box on a spark job definition's "Main Definition File" "ADLS-Gen2 path". this would be useful to set base and variable paths across all spark jobs...mfink_db3 hours agoNew MemberNew223Views2likes1Comment