<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>rss.livelink.threads-in-node</title>
    <link>https://community.fabric.microsoft.com/t5/Data-Factory-forums/ct-p/datafactory</link>
    <description>rss.livelink.threads-in-node</description>
    <pubDate>Sat, 14 Nov 2026 09:48:20 GMT</pubDate>
    <dc:creator>datafactory</dc:creator>
    <dc:date>2026-11-14T09:48:20Z</dc:date>
    <item>
      <title>Pipeline failures: retries, On fail paths or child pipelines?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Pipeline-failures-retries-On-fail-paths-or-child-pipelines/m-p/5414361#M9799</link>
      <description>&lt;P&gt;I set 3 retries with a 30 second interval on each Copy activity, and the alert fires when the whole pipeline fails. A transient error on one activity can still fail a long run. I tried adding an On fail path for a cleanup step, but I am not sure how the overall pipeline status is reported when On fail or On completion paths are used. What do you rely on: retries, On fail paths, or wrapping risky steps in child pipelines?&lt;/P&gt;</description>
      <pubDate>Fri, 13 Nov 2026 00:53:43 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Pipeline-failures-retries-On-fail-paths-or-child-pipelines/m-p/5414361#M9799</guid>
      <dc:creator>jubinsoni</dc:creator>
      <dc:date>2026-11-13T00:53:43Z</dc:date>
    </item>
    <item>
      <title>Metadata-driven copy pipeline or one pipeline per table: what held up for you?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Metadata-driven-copy-pipeline-or-one-pipeline-per-table-what/m-p/5410563#M9794</link>
      <description>&lt;P&gt;Hi all,&lt;/P&gt;&lt;P&gt;We have roughly 80 source tables to ingest into a lakehouse. I am torn between one generic pipeline driven by a control table (ForEach over a Lookup, with the table name, load type and so on as parameters) and a separate pipeline per source.&lt;/P&gt;&lt;P&gt;The generic version is easier to maintain, but I worry about a few things: one bad table slowing or failing the whole run, per-table logging, and the odd source that needs special handling.&lt;/P&gt;&lt;P&gt;If you went generic, where do you keep the control table, how do you cap ForEach concurrency and handle retries, and which sources ended up as exceptions with their own pipeline? And if you went the other way, did the maintenance get painful?&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Wed, 11 Nov 2026 18:47:42 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Metadata-driven-copy-pipeline-or-one-pipeline-per-table-what/m-p/5410563#M9794</guid>
      <dc:creator>jubinsoni</dc:creator>
      <dc:date>2026-11-11T18:47:42Z</dc:date>
    </item>
    <item>
      <title>What are the best practices for building reliable data pipelines in Microsoft Fabric Data Factory?</title>
      <link>https://community.fabric.microsoft.com/t5/Dataflow/What-are-the-best-practices-for-building-reliable-data-pipelines/m-p/5410453#M5874</link>
      <description>&lt;P&gt;I'm exploring Microsoft Fabric Data Factory and would like to learn how other professionals design and manage reliable data integration pipelines.&lt;/P&gt;&lt;P&gt;When working with multiple data sources and scheduled workflows, maintaining pipeline reliability, handling failures, and monitoring execution are important.&lt;/P&gt;&lt;P&gt;I'd appreciate practical insights on the following:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;What are the best practices for designing reusable pipelines in Fabric Data Factory?&lt;/LI&gt;&lt;LI&gt;How do you handle pipeline failures and configure retry mechanisms?&lt;/LI&gt;&lt;LI&gt;What is the recommended approach for managing dependencies between pipeline activities?&lt;/LI&gt;&lt;LI&gt;How can parameters and dynamic expressions make pipelines more flexible?&lt;/LI&gt;&lt;LI&gt;Which monitoring techniques help identify performance bottlenecks and failed activities?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;I'd love to hear about your real-world experiences and recommendations for building scalable and maintainable data pipelines.&lt;/P&gt;</description>
      <pubDate>Wed, 11 Nov 2026 17:53:17 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Dataflow/What-are-the-best-practices-for-building-reliable-data-pipelines/m-p/5410453#M5874</guid>
      <dc:creator>codeautomation</dc:creator>
      <dc:date>2026-11-11T17:53:17Z</dc:date>
    </item>
    <item>
      <title>Managing Configurations and Secrets Across Fabric Airflow Environments</title>
      <link>https://community.fabric.microsoft.com/t5/Apache-Airflow-Job/Managing-Configurations-and-Secrets-Across-Fabric-Airflow/m-p/5405112#M252</link>
      <description>&lt;H1&gt;As Apache Airflow workflows move from development to testing and production, managing environment-specific configurations can become challenging.&lt;/H1&gt;&lt;P&gt;For example, a DAG may work perfectly in development but require different connection settings, credentials, storage locations, and environment variables when deployed to production.&lt;/P&gt;&lt;P&gt;I'm interested in understanding how teams handle this in Microsoft Fabric Apache Airflow Jobs.&lt;/P&gt;&lt;P&gt;A few questions for the community:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;How do you manage connections and credentials without hardcoding sensitive information in DAG files?&lt;/LI&gt;&lt;LI&gt;Do you maintain separate configurations for development, staging, and production?&lt;/LI&gt;&lt;LI&gt;How do you handle environment variables and secret rotation?&lt;/LI&gt;&lt;LI&gt;What is your preferred approach for promoting DAG changes across environments without manually updating every configuration?&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;For teams managing multiple Airflow workflows, what practices have helped you make deployments more secure, consistent, and maintainable?&lt;/P&gt;&lt;P&gt;Would love to hear practical experiences and recommendations from the community.&lt;/P&gt;</description>
      <pubDate>Mon, 09 Nov 2026 17:32:36 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Apache-Airflow-Job/Managing-Configurations-and-Secrets-Across-Fabric-Airflow/m-p/5405112#M252</guid>
      <dc:creator>codeautomation</dc:creator>
      <dc:date>2026-11-09T17:32:36Z</dc:date>
    </item>
    <item>
      <title>[Open Mirroring] Incremental CSV Upload Overwrites Existing File and Changes Are Not Replicated</title>
      <link>https://community.fabric.microsoft.com/t5/Mirroring/Open-Mirroring-Incremental-CSV-Upload-Overwrites-Existing-File/m-p/5403852#M293</link>
      <description>&lt;P&gt;Hi Team,&lt;/P&gt;&lt;P&gt;I'd like to report a possible issue with &lt;STRONG&gt;Microsoft Fabric Open Mirroring (manual CSV upload)&lt;/STRONG&gt;.&lt;/P&gt;&lt;P&gt;A customer reported that the initial CSV upload works, but subsequent uploads (UPDATE/INSERT) are not reflected in the mirrored table.&lt;/P&gt;&lt;P&gt;I was able to &lt;STRONG&gt;reproduce the same behavior in my own Fabric test environment&lt;/STRONG&gt;.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Steps to reproduce:&lt;/STRONG&gt;&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;Create a new Open Mirrored Database.&lt;/LI&gt;&lt;LI&gt;Upload 00000000000000000001.csv with 3 records and create a table with a primary key.&lt;/LI&gt;&lt;LI&gt;Confirm that all 3 records are successfully replicated.&lt;/LI&gt;&lt;LI&gt;Upload a second file, 00000000000000000002.csv, using &lt;STRONG&gt;Upload files → Update existing table&lt;/STRONG&gt;.&lt;/LI&gt;&lt;LI&gt;Test both UPDATE (__rowMarker__ = 1) and INSERT (__rowMarker__ = 0) operations.&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;&lt;STRONG&gt;Actual behavior:&lt;/STRONG&gt;&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Initial replication works correctly (3 rows).&lt;/LI&gt;&lt;LI&gt;Subsequent UPDATE/INSERT operations are not reflected.&lt;/LI&gt;&lt;LI&gt;Replication status remains Running, but the replicated row count stays at 3.&lt;/LI&gt;&lt;LI&gt;Workspace Monitoring logs show the initial Snapshotting and StartReplicating operations, but no subsequent incremental replication activity.&lt;/LI&gt;&lt;LI&gt;I checked the Landing Zone using Azure Storage Explorer and confirmed that &lt;STRONG&gt;the second CSV file was not created. Instead, the first CSV file (&lt;/STRONG&gt;&lt;STRONG&gt;000...001.csv&lt;/STRONG&gt;&lt;STRONG&gt;) was overwritten with the content of the second CSV&lt;/STRONG&gt;, despite uploading a different filename (000...002.csv).&lt;/LI&gt;&lt;LI&gt;The same behavior was reproduced across 3 different tables.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;STRONG&gt;Expected behavior:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;The incremental CSV should be processed as a new change file, and the changes should be reflected in the mirrored table.&lt;/P&gt;&lt;P&gt;According to the Microsoft documentation, manual incremental uploads are supported:&lt;/P&gt;&lt;P&gt;&lt;A href="https://learn.microsoft.com/en-us/fabric/mirroring/open-mirroring-tutorial" target="_blank"&gt;https://learn.microsoft.com/en-us/fabric/mirroring/open-mirroring-tutorial&lt;/A&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Questions:&lt;/STRONG&gt;&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;Is this a known issue with the Fabric portal's &lt;STRONG&gt;Upload files&lt;/STRONG&gt; feature?&lt;/LI&gt;&lt;LI&gt;Is there any additional configuration required for incremental CSV uploads?&lt;/LI&gt;&lt;LI&gt;Is there a recommended workaround?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;Any guidance from the Fabric Mirroring team would be greatly appreciated.&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Mon, 09 Nov 2026 07:44:49 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Mirroring/Open-Mirroring-Incremental-CSV-Upload-Overwrites-Existing-File/m-p/5403852#M293</guid>
      <dc:creator>dzfamy</dc:creator>
      <dc:date>2026-11-09T07:44:49Z</dc:date>
    </item>
    <item>
      <title>Pipeline alerting: how do you notify the right team without flooding a channel?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Pipeline-alerting-how-do-you-notify-the-right-team-without/m-p/5402299#M9787</link>
      <description>&lt;P&gt;Hi everyone,&lt;/P&gt;&lt;P&gt;We have around fifty scheduled pipelines and the current alerting is a Teams activity on every failure path, which means a single upstream outage produces dozens of messages. We would like something closer to one alert per incident.&lt;/P&gt;&lt;P&gt;One idea is to write a status row at the end of every run and alert from there:&lt;/P&gt;&lt;LI-CODE lang="sql"&gt;INSERT INTO ops.PipelineRun
    (PipelineName, RunId, Status, ErrorMessage, FinishedUtc, OwnerTeam)
VALUES
    (@PipelineName, @RunId, @Status, @ErrorMessage, SYSUTCDATETIME(), @OwnerTeam);&lt;/LI-CODE&gt;&lt;H4&gt;What I am trying to decide&lt;/H4&gt;&lt;UL&gt;&lt;LI&gt;Whether to alert from each pipeline, or from one monitoring pipeline that reads the status table on a schedule.&lt;/LI&gt;&lt;LI&gt;How to group failures that share a root cause, such as a failing source system, into a single message.&lt;/LI&gt;&lt;LI&gt;How to route to the owning team and avoid repeating the same alert every hour until it is fixed.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;If you have a pattern that works for you, including how you handle retries before an alert is raised, I would like to hear it. Thanks!&lt;/P&gt;</description>
      <pubDate>Sun, 08 Nov 2026 00:49:16 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Pipeline-alerting-how-do-you-notify-the-right-team-without/m-p/5402299#M9787</guid>
      <dc:creator>jubinsoni</dc:creator>
      <dc:date>2026-11-08T00:49:16Z</dc:date>
    </item>
    <item>
      <title>How Do You Handle DAG Failures and Retries in Microsoft Fabric Apache Airflow Jobs?</title>
      <link>https://community.fabric.microsoft.com/t5/Apache-Airflow-Job/How-Do-You-Handle-DAG-Failures-and-Retries-in-Microsoft-Fabric/m-p/5395735#M249</link>
      <description>&lt;P&gt;Hi everyone,&lt;/P&gt;&lt;P&gt;I'm exploring how teams handle failure recovery and retry strategies when running Apache Airflow jobs in Microsoft Fabric, particularly for production workflows involving Fabric notebooks, Lakehouses, and data transformation tasks.&lt;/P&gt;&lt;P&gt;One challenge with DAG-based orchestration is ensuring that retries don't accidentally duplicate data, repeat expensive processing, or trigger downstream tasks when upstream operations haven't completed successfully.&lt;/P&gt;&lt;P&gt;I'd appreciate insights from developers and data engineers using Fabric Apache Airflow jobs.&lt;/P&gt;&lt;P&gt;A few questions:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;&lt;STRONG&gt;Retry Strategies:&lt;/STRONG&gt; How do you configure task-level retries and retry delays for transient failures without repeatedly executing tasks that have already completed?&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Idempotency:&lt;/STRONG&gt; What approaches do you use to prevent duplicate records or repeated updates when a failed DAG task runs again?&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Failure Recovery:&lt;/STRONG&gt; When a multi-step DAG fails halfway through execution, do you retry individual tasks, rerun the entire DAG, or use checkpoint-based recovery?&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Monitoring and Alerts:&lt;/STRONG&gt; How are you tracking failed DAG runs and notifying teams about critical execution failures?&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Dependency Management:&lt;/STRONG&gt; How do you manage dependencies between Fabric notebooks, pipelines, and other tasks to avoid downstream execution before upstream processing is complete?&lt;/LI&gt;&lt;LI&gt;&lt;STRONG&gt;Production Operations:&lt;/STRONG&gt; What patterns have worked best for handling timeouts, backfills, and unexpected infrastructure interruptions?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;I'm particularly interested in real-world implementations where Apache Airflow orchestrates multiple Microsoft Fabric workloads.&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;For production DAGs, do you prefer automatic retries with idempotent tasks or controlled manual recovery for failed workflows?&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Would appreciate any architecture recommendations, implementation examples, or lessons learned from production environments.&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Thu, 05 Nov 2026 09:49:31 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Apache-Airflow-Job/How-Do-You-Handle-DAG-Failures-and-Retries-in-Microsoft-Fabric/m-p/5395735#M249</guid>
      <dc:creator>codeautomation</dc:creator>
      <dc:date>2026-11-05T09:49:31Z</dc:date>
    </item>
    <item>
      <title>What Are the Best Practices for Building Reliable and Scalable Data Pipelines?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/What-Are-the-Best-Practices-for-Building-Reliable-and-Scalable/m-p/5389264#M9783</link>
      <description>&lt;P&gt;As organizations integrate data from multiple applications, databases, APIs, and cloud platforms, building reliable data pipelines becomes increasingly important.&lt;/P&gt;&lt;P&gt;A pipeline that works well with small datasets may encounter problems as data volumes grow and workflows become more complex. Failed activities, dependency issues, schema changes, and inconsistent execution can affect downstream processes and reporting.&lt;/P&gt;&lt;P&gt;I'd like to learn how the community handles these challenges in Microsoft Fabric Data Factory.&lt;/P&gt;&lt;P&gt;A few questions:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;How do you design pipelines to handle large datasets efficiently?&lt;/LI&gt;&lt;LI&gt;What is your approach to implementing retries, failure handling, and recovery mechanisms?&lt;/LI&gt;&lt;LI&gt;How do you manage dependencies between multiple pipelines and activities?&lt;/LI&gt;&lt;LI&gt;What strategies do you use for incremental data loading and avoiding duplicate records?&lt;/LI&gt;&lt;LI&gt;How do you monitor pipeline execution and identify failures before they affect downstream systems?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;I'd especially appreciate practical examples involving Microsoft Fabric Data Factory, pipeline orchestration, and automated monitoring.&lt;/P&gt;&lt;P&gt;What practices have helped you build more reliable data pipelines?&lt;/P&gt;</description>
      <pubDate>Tue, 03 Nov 2026 19:35:40 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/What-Are-the-Best-Practices-for-Building-Reliable-and-Scalable/m-p/5389264#M9783</guid>
      <dc:creator>codeautomation</dc:creator>
      <dc:date>2026-11-03T19:35:40Z</dc:date>
    </item>
    <item>
      <title>How can AI agents improve Microsoft Fabric Data Factory pipeline automation?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/How-can-AI-agents-improve-Microsoft-Fabric-Data-Factory-pipeline/m-p/5389251#M9782</link>
      <description>&lt;P&gt;I am exploring how AI agents can help make data pipeline development and monitoring more efficient in Microsoft Fabric Data Factory.&lt;/P&gt;&lt;P&gt;Some potential use cases:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Automatically creating pipeline workflows based on business requirements&lt;/LI&gt;&lt;LI&gt;Detecting pipeline failures and suggesting fixes&lt;/LI&gt;&lt;LI&gt;Optimizing data movement and transformation steps&lt;/LI&gt;&lt;LI&gt;Monitoring data quality and identifying anomalies&lt;/LI&gt;&lt;LI&gt;Triggering automated actions through APIs or external tools&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;I would like to understand how teams are currently combining AI agents with Fabric Data Factory.&lt;/P&gt;&lt;P&gt;Are you using:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;AI-assisted pipeline generation?&lt;/LI&gt;&lt;LI&gt;Automated error analysis and recovery workflows?&lt;/LI&gt;&lt;LI&gt;Fabric notebooks with AI models for data operations?&lt;/LI&gt;&lt;LI&gt;Custom agents connected with Data Factory pipelines?&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;Would appreciate insights, real-world examples, or architecture patterns from developers working with Fabric Data Factory automation.&lt;/P&gt;</description>
      <pubDate>Tue, 03 Nov 2026 19:32:07 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/How-can-AI-agents-improve-Microsoft-Fabric-Data-Factory-pipeline/m-p/5389251#M9782</guid>
      <dc:creator>codeautomation</dc:creator>
      <dc:date>2026-11-03T19:32:07Z</dc:date>
    </item>
    <item>
      <title>Fabric Pipeline: Best way to handle incremental loads from multiple source tables?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-Best-way-to-handle-incremental-loads-from/m-p/5383156#M9773</link>
      <description>&lt;P&gt;I'm building a Fabric pipeline to load around 40 SQL Server tables into a Lakehouse. Some tables contain millions of records, so full loads are not practical.&lt;/P&gt;&lt;P&gt;Would you recommend using a single metadata control table to manage incremental loads, or maintaining separate watermarks for each table?&lt;/P&gt;&lt;P&gt;Also, how would you handle tables without a LastModifiedDate column?&lt;/P&gt;&lt;P&gt;Would love to hear how others are handling this in production.&lt;/P&gt;</description>
      <pubDate>Mon, 02 Nov 2026 20:02:44 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-Best-way-to-handle-incremental-loads-from/m-p/5383156#M9773</guid>
      <dc:creator>Ar_Sh</dc:creator>
      <dc:date>2026-11-02T20:02:44Z</dc:date>
    </item>
    <item>
      <title>Fabric Pipeline: Best way to handle incremental loads from multiple source tables?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-Best-way-to-handle-incremental-loads-from/m-p/5383155#M9772</link>
      <description>&lt;P&gt;I'm building a Fabric pipeline to load around 40 SQL Server tables into a Lakehouse. Some tables contain millions of records, so full loads are not practical.&lt;/P&gt;&lt;P&gt;Would you recommend using a single metadata control table to manage incremental loads, or maintaining separate watermarks for each table?&lt;/P&gt;&lt;P&gt;Also, how would you handle tables without a LastModifiedDate column?&lt;/P&gt;&lt;P&gt;Would love to hear how others are handling this in production.&lt;/P&gt;</description>
      <pubDate>Mon, 02 Nov 2026 20:02:40 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-Best-way-to-handle-incremental-loads-from/m-p/5383155#M9772</guid>
      <dc:creator>Ar_Sh</dc:creator>
      <dc:date>2026-11-02T20:02:40Z</dc:date>
    </item>
    <item>
      <title>Error handling pattern for ForEach with partial failures: continue and report, or fail fast?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Error-handling-pattern-for-ForEach-with-partial-failures/m-p/5378439#M9762</link>
      <description>&lt;P&gt;Hi everyone,&lt;/P&gt;&lt;P&gt;I have a pipeline that loops over a list of tables with ForEach and runs a Copy activity per item. When one table fails, I would like the remaining tables to still load, and to get one consolidated failure report at the end instead of the whole run failing on the first error.&lt;/P&gt;&lt;P&gt;The pattern I am considering:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Wrap the Copy activity so its failure path (the On fail dependency) logs the table name and error message to a control table, and the ForEach item itself finishes as succeeded.&lt;/LI&gt;&lt;LI&gt;After the loop, a Script or Lookup activity counts rows in the control table for this run, and a Fail activity raises one error with the summary if the count is above zero.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;A sketch of the final check:&lt;/P&gt;&lt;LI-CODE lang="sql"&gt;SELECT COUNT(*) AS failed_tables
FROM ctl.load_log
WHERE run_id = @{pipeline().RunId}
  AND status = 'Failed';&lt;/LI-CODE&gt;&lt;P&gt;Questions:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Is this the usual approach, or is there a built-in way to get partial-success semantics for a ForEach?&lt;/LI&gt;&lt;LI&gt;How do you make sure the pipeline run status still reflects the failures so alerts fire?&lt;/LI&gt;&lt;LI&gt;Any gotchas with the sequential versus parallel setting when logging from inside the loop?&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;Thanks in advance.&lt;/P&gt;</description>
      <pubDate>Fri, 30 Oct 2026 05:28:08 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Error-handling-pattern-for-ForEach-with-partial-failures/m-p/5378439#M9762</guid>
      <dc:creator>jubinsoni</dc:creator>
      <dc:date>2026-10-30T05:28:08Z</dc:date>
    </item>
    <item>
      <title>Will Invoke Pipeline (Legacy) be deprecated?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Will-Invoke-Pipeline-Legacy-be-deprecated/m-p/5378085#M9757</link>
      <description>&lt;P&gt;Is there currently any plan or timeline to deprecate&amp;nbsp;&lt;STRONG&gt;Invoke Pipeline (Legacy)&lt;/STRONG&gt; in Microsoft Fabric?&lt;/P&gt;&lt;P&gt;For same-workspace pipeline orchestration, the Legacy activity is still very convenient. The new &lt;STRONG&gt;Invoke Pipeline&lt;/STRONG&gt; activity provides additional capabilities, such as cross-workspace invocation and child-pipeline monitoring, but it also requires a Connection object.&lt;/P&gt;&lt;P&gt;Given the performance concerns that have been reported by multiple users, I’m wondering what the recommended approach is:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Is it safe to continue using &lt;STRONG&gt;Invoke Pipeline (Legacy)&lt;/STRONG&gt; for now?&lt;/LI&gt;&lt;LI&gt;Does Microsoft recommend migrating existing pipelines to the new &lt;STRONG&gt;Invoke Pipeline&lt;/STRONG&gt; activity?&lt;/LI&gt;&lt;LI&gt;Is there any indication that the Legacy activity will eventually be deprecated or removed?&lt;/LI&gt;&lt;LI&gt;Should we already start rebuilding existing pipeline orchestration using the new activity and Connections?&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;It would be great to understand the intended direction, especially before investing time in rebuilding existing pipeline implementations.&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Thu, 29 Oct 2026 09:30:45 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Will-Invoke-Pipeline-Legacy-be-deprecated/m-p/5378085#M9757</guid>
      <dc:creator>benitovbreugel</dc:creator>
      <dc:date>2026-10-29T09:30:45Z</dc:date>
    </item>
    <item>
      <title>Can parallel pipeline runs upsert into the same Lakehouse table without commit conflicts?</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Can-parallel-pipeline-runs-upsert-into-the-same-Lakehouse-table/m-p/5377740#M9749</link>
      <description>&lt;P&gt;I want to ingest from 10 DB2 databases&amp;nbsp; into a Lakehouse using one generic pipeline, invoked once per DB. They all write into the same Bronze tables (e.g. .raw_&amp;lt;table&amp;gt;). Every row carries a _db_id, so no two runs ever touch the same record.&lt;/P&gt;&lt;P&gt;The Copy activity uses &lt;STRONG&gt;Table action = Upsert&lt;/STRONG&gt; with key columns _db_id + the source primary key. The tables are not partitioned or clustered. In DESCRIBE HISTORY the commits show operation = MERGE, engineInfo = datafactorycopy, and operationParameters, operationMetrics, readVersion and isBlindAppend are all NULL.&lt;/P&gt;&lt;P&gt;I would like to run the DBs in parallel, but we are unsure about commit conflicts. The&amp;nbsp;&lt;A class="lia-external-url" href="https://learn.microsoft.com/en-us/fabric/data-engineering/delta-lake-concurrency-control?tabs=sparksql" target="_blank"&gt;concurrency control article&lt;/A&gt; says conflicts depend on the files a MERGE reads, and that the partition column must be a literal in the merge condition. It describes Spark, though, and I could not find anything about the Copy sink.&lt;/P&gt;&lt;P&gt;Questions:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;Does the Copy activity upsert read the whole target table during the MERGE, or can it prune files, for example by _db_id?&lt;/LI&gt;&lt;LI&gt;Can two parallel Copy upserts (different DBs, same table) fail with something like ConcurrentAppendException? Does the sink retry internally?&lt;/LI&gt;&lt;LI&gt;Would partitioning the table by _db_id help with the Copy sink, even though we cannot set a literal predicate?&lt;/LI&gt;&lt;LI&gt;Is there a recommended pattern for this, for example append into per-DB staging tables and a single MERGE afterwards?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;For now we run the DBs sequentially. Any experience or documentation pointers would be appreciated.&lt;/P&gt;</description>
      <pubDate>Wed, 28 Oct 2026 07:01:04 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Can-parallel-pipeline-runs-upsert-into-the-same-Lakehouse-table/m-p/5377740#M9749</guid>
      <dc:creator>Microfyx</dc:creator>
      <dc:date>2026-10-28T07:01:04Z</dc:date>
    </item>
    <item>
      <title>Copy job vs pipeline + watermark table for incremental loads from Azure SQL: production experiences?</title>
      <link>https://community.fabric.microsoft.com/t5/Copy-job/Copy-job-vs-pipeline-watermark-table-for-incremental-loads-from/m-p/5377660#M329</link>
      <description>&lt;P&gt;Hi all,&lt;/P&gt;&lt;P&gt;I'm comparing Copy job with a classic pipeline (Lookup + Copy activity + watermark table) for incremental loads from Azure SQL Database into a Lakehouse, for around a few dozen tables.&lt;/P&gt;&lt;P&gt;The pipeline version is the pattern most of us know:&lt;/P&gt;&lt;LI-CODE lang="none"&gt;Lookup: SELECT LastWatermark FROM etl.Watermark WHERE TableName = @{item().name}
Copy:   SELECT * FROM @{item().name} WHERE ModifiedDate &amp;gt; '@{activity('Lookup').output.firstRow.LastWatermark}'
Stored proc: UPDATE etl.Watermark SET LastWatermark = &amp;lt;max ModifiedDate copied&amp;gt;&lt;/LI-CODE&gt;&lt;P&gt;Copy job seems to cover most of this out of the box (incremental column per table, state tracked for you), which is attractive because there is much less to maintain.&lt;/P&gt;&lt;P&gt;Before choosing, I'd like to understand a few things from people using Copy job in production:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;Visibility: when a single table fails, how easy is it to see which table and why, and to rerun only that one?&lt;/LI&gt;&lt;LI&gt;Resetting state: if a table needs a full reload (schema change, data fix), can you reset the watermark for just that table?&lt;/LI&gt;&lt;LI&gt;Deletes: for sources where rows are deleted, how are you handling it with Copy job, or do you fall back to mirroring / a pipeline for those tables?&lt;/LI&gt;&lt;LI&gt;CI/CD: does Copy job work cleanly with Git integration and deployment pipelines, including connection changes between Dev and Prod?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;Any experience or lessons learned would be really helpful.&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Tue, 27 Oct 2026 19:39:11 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Copy-job/Copy-job-vs-pipeline-watermark-table-for-incremental-loads-from/m-p/5377660#M329</guid>
      <dc:creator>jubinsoni</dc:creator>
      <dc:date>2026-10-27T19:39:11Z</dc:date>
    </item>
    <item>
      <title>Dataflow Gen2 parameter works with current value but fails when passed from Fabric Pipeline</title>
      <link>https://community.fabric.microsoft.com/t5/Dataflow/Dataflow-Gen2-parameter-works-with-current-value-but-fails-when/m-p/5377544#M5860</link>
      <description>&lt;P&gt;I have a Dataflow Gen2 that calls a SOAP API using Web.Contents().&lt;/P&gt;&lt;P&gt;The Dataflow has an APIKey Text parameter, which I use in Power Query:&lt;/P&gt;&lt;BLOCKQUOTE&gt;&lt;P&gt;v_apikey = Text.From(APIKey)&lt;/P&gt;&lt;/BLOCKQUOTE&gt;&lt;P&gt;The value is inserted into the SOAP request header/body before making the Web.Contents() call.&lt;/P&gt;&lt;P&gt;The issue:&lt;/P&gt;&lt;BLOCKQUOTE&gt;&lt;P&gt;API key entered as the Dataflow parameter's current value → Works&lt;/P&gt;&lt;P&gt;Exact same API key passed from a Fabric Pipeline parameter → Fails&lt;/P&gt;&lt;/BLOCKQUOTE&gt;&lt;P&gt;The failure eventually results in:&lt;/P&gt;&lt;BLOCKQUOTE&gt;&lt;P&gt;Expression.Error:&lt;/P&gt;&lt;P&gt;There weren't enough elements in the enumeration to complete the operation.&lt;/P&gt;&lt;P&gt;The SOAP XML navigation also shows an empty table:&lt;/P&gt;&lt;P&gt;#table({"Name", "Table"}, {})&lt;/P&gt;&lt;/BLOCKQUOTE&gt;&lt;P&gt;I'm trying to understand the runtime execution path:&lt;/P&gt;&lt;P&gt;Pipeline parameter&lt;/P&gt;&lt;P&gt;&amp;nbsp;→ Dataflow activity&lt;/P&gt;&lt;P&gt;&amp;nbsp; &amp;nbsp; → Dataflow parameter&lt;/P&gt;&lt;P&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; → Power Query&lt;/P&gt;&lt;P&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;→ Web.Contents()&lt;/P&gt;&lt;P&gt;Does Dataflow Gen2 apply Pipeline parameter overrides before Power Query/Web.Contents is evaluated, including any metadata evaluation?&lt;/P&gt;&lt;P&gt;Are there known limitations when a runtime Dataflow parameter is used inside the POST body of Web.Contents()?&lt;/P&gt;&lt;P&gt;Also, is there a safe way to verify that the Pipeline-supplied API key reached Power Query correctly without exposing the key itself?&lt;/P&gt;</description>
      <pubDate>Tue, 27 Oct 2026 14:36:11 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Dataflow/Dataflow-Gen2-parameter-works-with-current-value-but-fails-when/m-p/5377544#M5860</guid>
      <dc:creator>eyeampraveen</dc:creator>
      <dc:date>2026-10-27T14:36:11Z</dc:date>
    </item>
    <item>
      <title>Unable to Submit a Microsoft Fabric Technical Support Ticket: Only 'Add New Contract' Available</title>
      <link>https://community.fabric.microsoft.com/t5/Dataflow/Unable-to-Submit-a-Microsoft-Fabric-Technical-Support-Ticket/m-p/5377462#M5859</link>
      <description>&lt;P&gt;Hello Microsoft Fabric Community,&lt;/P&gt;&lt;P&gt;I am seeking assistance with accessing Microsoft Fabric technical support for an unresolved Dataflow Gen2 authentication issue.&lt;/P&gt;&lt;P&gt;I have an existing discussion covering the complete technical investigation, troubleshooting history and diagnostic results:&lt;/P&gt;&lt;P&gt;&lt;A href="https://community.fabric.microsoft.com/discussions/df_dataflows/dataflow-gen2-lakehouse-connection-fails-with-aadsts70008/5375848" target="_blank"&gt;Dataflow Gen2 Lakehouse connection fails with AADSTS70008 | Original Discussion&lt;/A&gt;&lt;/P&gt;&lt;P&gt;Rather than repeating the entire troubleshooting history, I am opening this focused discussion to seek help with the remaining support-access issue.&lt;/P&gt;&lt;H3&gt;1. Brief technical background&lt;/H3&gt;&lt;P&gt;My original Dataflow Gen2 connection to LakeHouse_Training in the Nikolai_Schuler_Udemy workspace fails with:&lt;/P&gt;&lt;P&gt;AADSTS70008: The provided authorization code or refresh token has expired due to inactivity.&lt;/P&gt;&lt;P&gt;Attempts to update credentials or create a new connection to the original Lakehouse also result in an Invalid credentials message.&lt;/P&gt;&lt;P&gt;I completed a clean-room diagnostic test using the same Microsoft Entra tenant, organizational account and Fabric trial capacity.&lt;/P&gt;&lt;P&gt;The results were:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Created a new workspace: Fabric_OAuth_Diagnostic.&lt;/LI&gt;&lt;LI&gt;Created a new Lakehouse: LH_OAuth_Diagnostic.&lt;/LI&gt;&lt;LI&gt;Created a new Dataflow Gen2: DF_OAuth_Diagnostic.&lt;/LI&gt;&lt;LI&gt;Successfully established a fresh Organizational account connection.&lt;/LI&gt;&lt;LI&gt;Successfully imported CSV data and loaded it into a new Lakehouse table.&lt;/LI&gt;&lt;LI&gt;The Dataflow execution completed in approximately 22 seconds.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;However, connecting to the original LakeHouse_Training from the same diagnostic environment continues to fail.&lt;/P&gt;&lt;P&gt;This indicates that the issue appears to be specific to the original Lakehouse or its connection/authentication path. The underlying root cause remains unconfirmed.&lt;/P&gt;&lt;H3&gt;2. Microsoft Fabric technical support access issue&lt;/H3&gt;&lt;P&gt;I attempted to obtain technical assistance through the official Microsoft Fabric Support portal and the Contact Support option in Power BI/Fabric.&lt;/P&gt;&lt;P&gt;However, the Support plan dropdown only displays:&lt;/P&gt;&lt;P&gt;Add new contract&lt;/P&gt;&lt;P&gt;The Microsoft Fabric Subscription option is missing, and I cannot proceed with submitting a technical support request.&lt;/P&gt;&lt;P&gt;My environment:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;Microsoft Fabric trial capacity.&lt;/LI&gt;&lt;LI&gt;Fabric Free per-user license.&lt;/LI&gt;&lt;LI&gt;Organizational member account in a Microsoft Entra tenant.&lt;/LI&gt;&lt;LI&gt;Global Administrator permissions in the Entra tenant.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;I do not have a Unified or Premier support contract.&lt;/P&gt;&lt;P&gt;I also previously submitted an Azure Basic Support request for this issue, but it was closed because technical break-fix support is not covered by that plan.&lt;/P&gt;&lt;H3&gt;3. Microsoft documentation&lt;/H3&gt;&lt;P&gt;According to Microsoft's current documentation, users with a Fabric Free license can create support tickets for Fabric products.&lt;/P&gt;&lt;P&gt;The documentation also states that the support-plan selection can be made using Microsoft Fabric Subscription or a Unified/Premier support plan. The Add new contract option is intended for users who already have a Unified or Premier contract that is not listed.&lt;/P&gt;&lt;P&gt;Documentation:&lt;/P&gt;&lt;P&gt;&lt;A href="https://learn.microsoft.com/en-us/power-bi/support/create-support-ticket" target="_blank"&gt;https://learn.microsoft.com/en-us/power-bi/support/create-support-ticket&lt;/A&gt;&lt;/P&gt;&lt;P&gt;Unfortunately, my support form does not display the documented Microsoft Fabric Subscription option.&lt;/P&gt;&lt;H3&gt;4. Assistance requested&lt;/H3&gt;&lt;P&gt;Could someone from Microsoft Fabric Support or the Community Support team please clarify:&lt;/P&gt;&lt;OL&gt;&lt;LI&gt;Why is the Microsoft Fabric Subscription option missing from the support-plan dropdown?&lt;/LI&gt;&lt;LI&gt;Is there any additional prerequisite or account configuration required for a Fabric Free user with an active trial capacity to submit a technical support ticket?&lt;/LI&gt;&lt;LI&gt;Is there an alternative route to obtain a technical escalation for this Dataflow Gen2/Lakehouse connection issue?&lt;/LI&gt;&lt;/OL&gt;&lt;P&gt;I would particularly appreciate assistance from a Microsoft Fabric employee or someone who can route this to the appropriate Data Factory or Lakehouse connector support team.&lt;/P&gt;&lt;P&gt;I can provide the detailed Entra sign-in logs, trace IDs, correlation IDs, timestamps and other diagnostic information privately if required.&lt;/P&gt;&lt;P&gt;Thank you for your time and assistance.&lt;/P&gt;&lt;img /&gt;&lt;img /&gt;&lt;img /&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Tue, 27 Oct 2026 10:01:17 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Dataflow/Unable-to-Submit-a-Microsoft-Fabric-Technical-Support-Ticket/m-p/5377462#M5859</guid>
      <dc:creator>ShubhamJain2</dc:creator>
      <dc:date>2026-10-27T10:01:17Z</dc:date>
    </item>
    <item>
      <title>Fabric Pipeline fails with 'WorkspaceNotFound' on ADLS Gen2/OneLake connection</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-fails-with-WorkspaceNotFound-on-ADLS-Gen2/m-p/5377176#M9743</link>
      <description>&lt;P&gt;&lt;STRONG&gt;Hi everyone,&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;I am facing a critical issue with a Fabric pipeline that started last week. I would appreciate any insights or workarounds.&lt;/STRONG&gt;&lt;/P&gt;&lt;H3&gt;&lt;STRONG&gt;The Context &amp;amp; Trigger Event:&lt;/STRONG&gt;&lt;/H3&gt;&lt;OL&gt;&lt;LI&gt;Last week, all stored connections in my Fabric user profile under &lt;STRONG&gt;"Manage connections and gateways"&lt;/STRONG&gt;started expiring&lt;/LI&gt;&lt;LI&gt;I received a warning/banner indicating that I was very close to reaching the tenant limit of &lt;STRONG&gt;1,000 stored cloud connections&lt;/STRONG&gt;.&lt;/LI&gt;&lt;LI&gt;In parallel to this credential expiration event, a step in one of my pipelines started failing.&lt;/LI&gt;&lt;/OL&gt;&lt;H3&gt;&lt;STRONG&gt;The Pipeline Step:&lt;/STRONG&gt;&lt;/H3&gt;&lt;UL&gt;&lt;LI&gt;&lt;STRONG&gt;What it does:&lt;/STRONG&gt;It connects to an external SFTP server, downloads data, and writes it directly to&lt;STRONG&gt;OneLake Storage&lt;/STRONG&gt; using an &lt;STRONG&gt;Azure Data Lake Storage Gen2 (ADLS Gen2)&lt;/STRONG&gt; connection.&lt;/LI&gt;&lt;/UL&gt;&lt;H3&gt;&lt;STRONG&gt;The Odd Behavior:&lt;/STRONG&gt;&lt;/H3&gt;&lt;UL&gt;&lt;LI&gt;If I go to &lt;STRONG&gt;"Manage connections and gateways"&lt;/STRONG&gt;, the connection shows as &lt;STRONG&gt;Online&lt;/STRONG&gt; and healthy.&lt;/LI&gt;&lt;LI&gt;I have manually re-entered and updated the credentials there, and the UI says everything is OK (connection test passes in the gateway/connection manager).&lt;/LI&gt;&lt;LI&gt;However, when I run or test the connection directly &lt;STRONG&gt;inside the Pipeline&lt;/STRONG&gt;, it immediately fails with the following error:&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: 'onelake'. ErrorCode: 'WorkspaceNotFound'. Message: 'Not Found'. TimeStamp: 'Mon, 26 Oct 2026 11:49:43 GMT'.. Operation returned an invalid status code 'NotFound'&lt;/P&gt;&lt;H3&gt;&lt;STRONG&gt;What I have tried so far:&lt;/STRONG&gt;&lt;/H3&gt;&lt;UL&gt;&lt;LI&gt;Cleared and re-entered credentials in the connection settings.&lt;/LI&gt;&lt;LI&gt;Deleted unused connections to free up slot space below the 1,000 limit, but the pipeline error persists&lt;/LI&gt;&lt;LI&gt;It seems like the pipeline is pointing to a cached, corrupted connection ID token that cannot resolve the workspace path anymore, even though the connection is "green" in settings.&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&lt;STRONG&gt;Has anyone encountered this WorkspaceNotFound error on &amp;gt;onelake after hitting the connection limit? Is there a way to force the pipeline to bind to a fresh connection instance?&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Thanks in advance!&lt;/STRONG&gt;&lt;/P&gt;</description>
      <pubDate>Mon, 26 Oct 2026 12:14:07 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Fabric-Pipeline-fails-with-WorkspaceNotFound-on-ADLS-Gen2/m-p/5377176#M9743</guid>
      <dc:creator>debiagui</dc:creator>
      <dc:date>2026-10-26T12:14:07Z</dc:date>
    </item>
    <item>
      <title>Dataflow Gen2 Lakehouse connection fails with AADSTS70008</title>
      <link>https://community.fabric.microsoft.com/t5/Dataflow/Dataflow-Gen2-Lakehouse-connection-fails-with-AADSTS70008/m-p/5375848#M5851</link>
      <description>&lt;img /&gt;&lt;img /&gt;
&lt;P&gt;I am learning Microsoft Fabric and preparing for the DP-600 certification. I have spent several days trying to resolve a Dataflow Gen2 Lakehouse authentication failure, and I need help identifying the root cause.&lt;/P&gt;
&lt;P&gt;&lt;STRONG&gt;Environment&lt;/STRONG&gt;&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;Microsoft Fabric trial capacity, with a Fabric Free per-user license.&lt;/LI&gt;
&lt;LI&gt;Personal Azure Free account and a newly created Microsoft Entra tenant.&lt;/LI&gt;
&lt;LI&gt;Workspace: Nikolai_Schuler_Udemy.&lt;/LI&gt;
&lt;LI&gt;Lakehouse: LakeHouse_Training.&lt;/LI&gt;
&lt;LI&gt;Dataflow: Dataflow 1.&lt;/LI&gt;
&lt;LI&gt;Authentication: Organizational account, OAuth 2.0.&lt;/LI&gt;
&lt;LI&gt;Privacy level: Organizational.&lt;/LI&gt;
&lt;LI&gt;Gateway: None.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;The Entra tenant was originally created through an Azure signup using a personal Gmail account. I created an onmicrosoft.com member account with Global Administrator permissions and use that account for Fabric. The original Gmail identity exists in the tenant as a guest.&lt;/P&gt;
&lt;P&gt;&lt;STRONG&gt;Problem&lt;/STRONG&gt;&lt;/P&gt;
&lt;P&gt;Dataflow Gen2 cannot connect to the Lakehouse. The query editor displays “Credentials are required to connect to the Lakehouse source.”&lt;/P&gt;
&lt;P&gt;When creating or updating the connection, Fabric reports:&lt;/P&gt;
&lt;P&gt;AADSTS70008: The provided authorization code or refresh token has expired due to inactivity. Send a new interactive authorization request for this user and resource.&lt;/P&gt;
&lt;P&gt;HTTP status: 400&lt;BR /&gt;Cluster: &lt;A href="https://api.powerbi.com/" target="_blank" rel="noopener"&gt;https://api.powerbi.com&lt;/A&gt;&lt;/P&gt;
&lt;P&gt;The same failure occurs when editing credentials for an existing connection. The account picker can open, but reauthentication has not restored access. A newly created connection appears in Manage Connections, yet the Dataflow editor still cannot connect.&lt;/P&gt;
&lt;P&gt;&lt;STRONG&gt;Troubleshooting completed&lt;/STRONG&gt;&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;Tested Chrome, Edge, and Edge InPrivate.&lt;/LI&gt;
&lt;LI&gt;Retried interactive sign-in using the onmicrosoft.com member account.&lt;/LI&gt;
&lt;LI&gt;Confirmed Microsoft Authenticator MFA is registered.&lt;/LI&gt;
&lt;LI&gt;Tested existing and newly created Lakehouse connections.&lt;/LI&gt;
&lt;LI&gt;Used Edit credentials in Manage Connections and Gateways.&lt;/LI&gt;
&lt;LI&gt;Confirmed the Lakehouse and SQL analytics endpoint are accessible in Fabric.&lt;/LI&gt;
&lt;LI&gt;Enabled GitHub integration and successfully synchronized the workspace to a public GitHub repository. This did not resolve the authentication error.&lt;/LI&gt;
&lt;LI&gt;Checked Entra sign-in logs. A previous Power BI Data Refresh sign-in failed with error 70008, and the credential update continues to fail with the same error.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&lt;STRONG&gt;Support-access problem&lt;/STRONG&gt;&lt;/P&gt;
&lt;P&gt;Microsoft's current support documentation says Fabric Free users can submit support tickets for Fabric products. However, the Fabric Help and Support form only offers “Add new contract”; “Microsoft Fabric Subscription” is missing.&lt;/P&gt;
&lt;P&gt;I submitted an Azure subscription-management request, but it was closed because Basic Support does not cover technical issues. I still have no technical support case.&lt;/P&gt;
&lt;P&gt;&lt;STRONG&gt;Questions&lt;/STRONG&gt;&lt;/P&gt;
&lt;OL&gt;
&lt;LI&gt;Why does a fresh OAuth authorization continue to fail with AADSTS70008 in this new tenant?&lt;/LI&gt;
&lt;LI&gt;Is there a known issue with Dataflow Gen2, Power Query Online, or the Lakehouse connector's OAuth token handling?&lt;/LI&gt;
&lt;LI&gt;Could the tenant identity setup or Fabric trial capacity affect OAuth authorization or Fabric support eligibility?&lt;/LI&gt;
&lt;LI&gt;How can I obtain a proper Fabric technical support escalation as a Fabric Free user?&lt;/LI&gt;
&lt;/OL&gt;
&lt;P&gt;Could a Microsoft Fabric employee or Data Factory specialist investigate this and advise on the next diagnostic step? I can provide the full trace ID, correlation ID, request ID, tenant details, and screenshots privately if needed.&lt;/P&gt;</description>
      <pubDate>Tue, 20 Oct 2026 13:41:30 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Dataflow/Dataflow-Gen2-Lakehouse-connection-fails-with-AADSTS70008/m-p/5375848#M5851</guid>
      <dc:creator>ShubhamJain2</dc:creator>
      <dc:date>2026-10-20T13:41:30Z</dc:date>
    </item>
    <item>
      <title>Session tag restrictions for high concurrency mode in pipelines</title>
      <link>https://community.fabric.microsoft.com/t5/Pipelines/Session-tag-restrictions-for-high-concurrency-mode-in-pipelines/m-p/5375789#M9723</link>
      <description>&lt;P&gt;Hi all,&lt;/P&gt;&lt;P&gt;Our pipeline runs 3 notebooks in succession using high concurrency mode for pipelines with a session tag. The run failed with this error:&lt;/P&gt;&lt;LI-CODE lang=""&gt;Failed to run notebook due to invalid request. 
[Error: Session tag can only contain letters, numbers, and underscores. 
(Parameter 'HighConcurrencyModeOptions.SessionTag')]&lt;/LI-CODE&gt;&lt;P&gt;The tag we used was &lt;EM&gt;&lt;STRONG&gt;dataverse-ingest&lt;/STRONG&gt;&lt;/EM&gt;, so the hyphen seems to be the cause. We will switch to underscores, but I could not find this restriction in the Microsoft documentation.&lt;/P&gt;&lt;P&gt;Is the allowed character set for session tags documented anywhere? Are there other limitations (length, reserved words, case sensitivity) we should know about?&lt;/P&gt;&lt;P&gt;Thanks!&lt;/P&gt;</description>
      <pubDate>Tue, 20 Oct 2026 07:59:37 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Pipelines/Session-tag-restrictions-for-high-concurrency-mode-in-pipelines/m-p/5375789#M9723</guid>
      <dc:creator>AvdBerg</dc:creator>
      <dc:date>2026-10-20T07:59:37Z</dc:date>
    </item>
  </channel>
</rss>

