Forum Discussion

rafalencar1997's avatar
rafalencar1997
Regular Visitor
22 days ago
Solved

Copy Job Interface

Hi everyone, I'm currently using a Copy Job in Microsoft Fabric to ingest data from an on-premises Oracle database into OneLake. I have more than 100 tables to load, and for each one I'm using a c...
  • Vinodh247's avatar
    22 days ago

    The checkbox in the table/query selection pane is not a runtime toggle, it is a configuration selector. When you uncheck a query, Fabric treats it as “not part of the job” and removes it from the activity definition rather than just skipping execution. The “Exclude” option, on the other hand, is evaluated at runtime but still assumes the query exists in the config.

     

    Once a custom SQL query is removed this way, dont think there is a native recovery unless you have versioning in place (for ex, git integration or a saved JSON/export of the pipeline). Without that, you will need to recreate those queries manually.

     

    For dev, the practical approach is to avoid using the checkbox as a control mechanism. Instead, split workloads into smaller logical copy activities (for ex, per domain or batch of tables), parameterise the table/query list and drive execution via parameters, or use filters/flags in a metadata table to control which tables run. Another simple workaround is to duplicate the pipeline for testing and prune it there, keeping the original intact. In short, treat copy Job configuration as static and control execution dynamically rather than editing the selection each time.