Enhancing Data Factory: Support for Nested ForEach Loops and Conditional Logic
Currently, in Data Factory, the ForEach activity does not support nesting, meaning you cannot place one ForEach loop inside another. This limitation makes it difficult to process complex, hierarchical data structures where an outer loop needs to iterate over a set of items, and an inner loop should perform additional processing for each item. Allowing nested ForEach loops would enable more flexible and scalable workflows, eliminating the need for workarounds like using multiple pipelines or flattening data before processing.
Additionally, conditional logic inside ForEach loops is another missing capability. Right now, if you need to execute certain logic only when a condition is met inside a loop, you must create separate activities outside the loop or use multiple pipelines. Enabling If activities inside ForEach loops or allowing ForEach loops inside If activities would improve efficiency by allowing more dynamic decision-making without extra pipelines or unnecessary complexity.
These enhancements would provide greater flexibility, reduce pipeline fragmentation, and simplify workflow design.
Recent ideas
Provide a Read-Only / Source-Safe Mode for Schema Shortcuts in Lakehouse
Schema Shortcuts provide a much better management experience than individual Table Shortcuts because they preserve the source schema structure and allow multiple tables to be onboarded at once. Howev...Junghyoen33 minutes agoMicrosoft EmployeeNew9Views4likes0CommentsAccess Variable Library in Semantic Models
Enable the Variable Library as a centralized location for storing all environment‑specific variables, allowing us to adjust them for promotion scenarios (e.g., from dev to prod) without relying on de...FreddyH11 hours agoAdvocate IINew920Views31likes2CommentsEnhance Fabric Pipeline Monitoring with Parent-Child Pipeline Lineage and Parameter Visibility
Currently, Microsoft Fabric Pipeline monitoring lacks several capabilities that are available in Azure Data Factory, making troubleshooting and operational support challenging in enterprise environme...dwramreddy11 hours agoRegular VisitorNew8Views0likes0CommentsDynamic ADLS-Gen2 path input for Spark Jobs Main definition file
I would like the ability to add a dynamic input box on a spark job definition's "Main Definition File" "ADLS-Gen2 path". this would be useful to set base and variable paths across all spark jobs...mfink_db16 hours agoNew MemberNew238Views2likes2CommentsReintroduce Tenant/Capacity Switch to Control "Users can create Plan items" Post-GA
During the Preview phase of Fabric Plan items, administrators had access to a dedicated tenant/capacity setting: "Users can create Plan items". With General Availability (GA), this granular administr...Sri-Surendra_Ku19 hours agoNew MemberNew106Views14likes1Comment