Forum Discussion

verianalizi's avatar
verianalizi
Frequent Visitor
1 year ago
Solved

Copy Job, Database Table Listing Problem

Hello everyone,

I'm trying to copy some tables from SAP R/3 (MS SQL), but when I attempt this, the system tries to list all tables. Due to the large number of tables, it's impossible to display the entire list.

Has anyone encountered a similar issue or have suggestions on how to handle this?

Thanks in advance!

  • v-prasare's avatar
    v-prasare
    1 year ago

    verianalizi, my apologies here as above mentioned can be achived from data factory pipelines.

     

    can you please confirm once you have given connection details and click next, it should list all the tables like show below. 

     

    as you mentioned issue with listing huge number of tables, this might be due to limitations that is mentioned in Fabric documentation here. PFB screenshot for same.

     

     

    additionally, below copy job is in preview mode and i request you to please submit your feedback in documentation. your input is valuable and will help other users who might have similar questions. We appreciate your effort in sharing your thoughts

     

     What is Copy job (preview) in Data Factory - Microsoft Fabric | Microsoft Learn

     

     

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support.

     

    Did I answer your question? Mark my post as a solution, this will help others!

    If my response(s) assisted you in any way, don't forget to drop me a "Kudos

8 Replies

  • v-prasare's avatar
    v-prasare
    Community Support

    Hi verianalizi,

    Thanks for reachoing Microsoft Fabric community Support.

     

    Here are a few potential solutions you could try to handle this issue:

    • Limit the Table List: instead of attempting to display all tables at once, limit the number of tables shown. You can filter or sort the list based on specific criteria (e.g., table names, schemas, or metadata).

          Use SQL queries like:

                     SELECT TABLE_NAME

                     FROM INFORMATION_SCHEMA.TABLES

                     WHERE TABLE_NAME LIKE 'YourPattern%' -- or other filtering conditions

                     ORDER BY TABLE_NAME

     

    • Use Specific Table Names: If you're only interested in certain tables, directly reference the table names in your queries instead of trying to retrieve a list of all tables.

          For example:  SELECT * FROM YourTableName

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support.

     

    Did I answer your question? Mark my post as a solution, this will help others!

    If my response(s) assisted you in any way, don't forget to drop me a "Kudos

    • verianalizi's avatar
      verianalizi
      Frequent Visitor

      Hello,

       

      As you can see there is no such an option.

       

       

      • v-prasare's avatar
        v-prasare
        Community Support

        verianalizi, my apologies here as above mentioned can be achived from data factory pipelines.

         

        can you please confirm once you have given connection details and click next, it should list all the tables like show below. 

         

        as you mentioned issue with listing huge number of tables, this might be due to limitations that is mentioned in Fabric documentation here. PFB screenshot for same.

         

         

        additionally, below copy job is in preview mode and i request you to please submit your feedback in documentation. your input is valuable and will help other users who might have similar questions. We appreciate your effort in sharing your thoughts

         

         What is Copy job (preview) in Data Factory - Microsoft Fabric | Microsoft Learn

         

         

         

         

        Thanks,

        Prashanth Are

        MS Fabric community support.

         

        Did I answer your question? Mark my post as a solution, this will help others!

        If my response(s) assisted you in any way, don't forget to drop me a "Kudos

    • v-prasare's avatar
      v-prasare
      Community Support

      Use a Query to Limit the Table List

      Instead of listing all tables, use a custom query to narrow down the list of tables you need. The "Copy Job" feature should allow you to specify a source query.

       Steps:

      1. In the Copy Job wizard, when selecting the source, choose Query Mode instead of browsing the table list.
      2. You can also dynamically filter tables based on table names or schemas:

      SELECT  *  FROM INFORMATION_SCHEMA.TABLES  WHERE TABLE_NAME LIKE 'Z%'  -- Example to filter custom SAP tables

       

       

       

      Thanks,

      Prashanth Are

      MS Fabric community support.

       

      Did I answer your question? Mark my post as a solution, this will help others!

      If my response(s) assisted you in any way, don't forget to drop me a "Kudos"

    • v-prasare's avatar
      v-prasare
      Community Support

      verianalizi , As we haven’t heard back from you, we wanted to kindly follow up to check if the solution I have provided helps you? or let us know if you need any further assistance here?  

       

      Your feedback is important to us, Looking forward to your response.

       

      Thanks,

      Prashanth Are

      MS Fabric community support.

       

      Did I answer your question? Mark my post as a solution, this will help others!

      If my response(s) assisted you in any way, don't forget to drop me a "Kudos"

    • v-prasare's avatar
      v-prasare
      Community Support

      Hi verianalizi, Hope your doing well.

      As we haven’t heard back from you, we wanted to kindly follow up to check if the solution I have provided helps you?

       

      Your feedback is important to us, Looking forward to your response.

       

      Thanks,

      Prashanth Are

      MS Fabric community support.

       

      Did I answer your question? Mark my post as a solution, this will help others!

      If my response(s) assisted you in any way, don't forget to drop me a "Kudos"