Forum Discussion
Same SQL Source table - ADF Copy Activity Succeeds but Fabric Copy Activity Fails- Auto create table
I agree tayloramy , i got access to source SQL server and narrowed down on table.
Copy Activity Error Column 'delivery_instructions1'. Truncated value: 'Contact: Jorge – 8'.
deliver_instruction1 at source SQL table is varchar(20). I compared table structure side by side (SQL Server vs WH) and they are identical but fails with above error.
Value is 'Contact: Jorge – 832' - varchar(20).
All checks out fine. Not sure why its reporting about issues. when everything is to the dot. There are other tables running fine and few tables are having issues. Out 4 tables out of 93 ingestion tables. and have no idea why.
There are some 45 columns in total on this 1 table.
- tayloramy7 months agoSuper User
Hi AJAJ,
Interesting. I wonder if that em-dash is taking up more bytes in the fabric implementation.
If you set the target to be a varchar(25) or 30, does it work then?
If not. I think a ticket with mirosoft would be helpful here. Something is up.- AJAJ6 months agoHelper IV
Yes when i manually widended the target table column and it ran fine. Cant be declaring source table structures manually (each table has many columns so even if one column is casted to varchar greater than source, another column creates issue.) copy activity should autodetect especially when source is a SQL server.
Something is a bug. i wish someone from microsoft could take a look. I used trial version and paid version too. Both have same issue. I have worked on Azure copy activity for 5 yrs using various sources. Never came across this issue. i created this fabric pipeline from scratch multipletimes..95 tables to be processed - lookup and foreach loop thru with appropriate select statement (eg select col1, col2 from tableA and so on) on copy activity.
18 tables are causing similar error.
Verified len of Source SQL server tables and values. Fabric is turning out to be a crapy show here.
Same thing with reading pipedelimited csv files. Some files are fine but are having issues with copy activity while sames files runs smoothly in ADF.
- tayloramy6 months agoSuper User
Hi AJAJ,
I recommend you open a ticket with Microsoft.
Automatic mapping tools have come a long way, but they are not 100% reliable yet.
What you can do is in the source query, you can write a select statement that will cast the columns to a larger datatype, and then the copy data activity mapping will pick it up.