Forum Discussion

AJAJ's avatar
AJAJ
Helper IV
7 months ago

Same SQL Source table - ADF Copy Activity Succeeds but Fabric Copy Activity Fails- Auto create table

Hi there,   I'm using dynamic query to loop thru processing multiple tables. Source is SQL Server. Same table / Same query / Same SQL Source - Older ADF copy activity runs successfully. Fabri...
Need Help
pipelines
AJAJ's avatar
AJAJ
Helper IV
7 months ago

Yes when i manually widended the target table column and it ran fine. Cant be declaring source table structures manually (each table has many columns so even if one column is casted to varchar greater than source, another column creates issue.) copy activity should autodetect especially when source is a SQL server. 

Something is a bug. i wish someone from microsoft could take a look. I used trial version and paid version too. Both have same issue. I have worked on Azure copy activity for 5 yrs using various sources. Never came across this issue. i created this fabric pipeline from scratch multipletimes.. 

 

95 tables to be processed - lookup and foreach loop thru with appropriate select statement (eg select col1, col2 from tableA and so on)  on copy activity.

 

18 tables are causing similar error. 

 

 

 

Verified len of Source SQL server tables and values. Fabric is turning out to be a crapy show here.

 

Same thing with reading pipedelimited csv files. Some files are fine but are having issues with copy activity while sames files runs smoothly in ADF.

tayloramy's avatar
tayloramy
Super User
6 months ago

Hi AJAJ, 

 

I recommend you open a ticket with Microsoft. 

Automatic mapping tools have come a long way, but they are not 100% reliable yet.  

 

What you can do is in the source query, you can write a select statement that will cast the columns to a larger datatype, and then the copy data activity mapping will pick it up. 

 

 

    • AJAJ's avatar
      AJAJ
      Helper IV
      6 months ago

      tayloramy Thanks. Is this a paid support? Is there a microsoft bug reporting place where we can share any specific GUIDs that they can trace and fix. 

      • v-prasare's avatar
        v-prasare
        Community Support
        6 months ago

        Hi AJAJ,

        No this is not paid support though you need a powerbi subscription to raise support ticket and do include more information like failure details like error message, activity Id, capacity and other detail necessary to track and provide resolution to your case

         

         

        Thanks,

        Prashanth 

        MS Fabric community support