Forum Discussion
Billybilly
1 year agoFrequent Visitor
Issue with Dataflow Gen2 Copy
I am experiencing an issue with copying two tables from one lakehouse (with schema) to another lakehouse. The copy operation fails, but it succeeds when copying without the schema (using the same tab...
Billybilly
1 year agoFrequent Visitor
Hi NONO Chen,
Thank you for the response and the detailed suggestions.
To clarify further, no constraints are applied in this scenario, and there have been no changes to the data types, column names, or the number of columns between the source and target tables. Both tables are identical in structure.
Let me reiterate the key observation:
- Copy 1: Exists in the lakehouse with a schema applied.
- Copy 2: Exists in the lakehouse without a schema applied.
- It works successfully for Copy 2 but fails for Copy 1.
Based on this, I suspect the issue may not be related to column data types, names, or constraints.
Looking forward to your insights!
Best regards,
Billybilly
Anne-MarijnV
1 year agoFrequent Visitor
Hi,
unfortunately I don't have a solution to this problem, but I would just like to add that I'm having the exact same issue.
My table names also don't contain any special characters.
Example of table name is: companynamesalesdata