Forum Discussion
Copy data failing for dataverse table
Hello, I'm try to setup a Copy data activity. I want copy the dirpartytable, but even the preview fails with an error 21446 and the message "Invalid table! Parquet column is not defined in delta metadata. Column name: _change_type."
Any advice how to solve the problem?
Thanks Rüdiger
14 Replies
Unfortunately I haven't got any further update from Microsoft.
- FabianSchut
Solution Sage
Hi, this topic looks similar: https://community.fabric.microsoft.com/t5/Data-Engineering/Need-to-copy-tables-from-lakehouse-to-warehouse-in-the-same/td-p/4160458. They got it working with data flow gen2 instead of copy data in a data pipeline or use the SQL-endpoint. What is the source you are looking at?
However, they also suggest to create a support ticket, since it is not a long-term solution.
Ticket created, contact established, will keep you updated
- vivien57
Super User
Hello,
Have you had any news from MS support ? Is there a solution ?
Thank you in advance for your feedback
Have a nice day,
Vivien
Thank you very much FabianSchut for your prompt reply.
Please let us know if your issue is resolved. I look forward to you sharing the information you get!
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hello everybody, here a short summary for the issue.
I have created a ticket TrackingID#2411061420002831 with the Microsoft Support. Currently the change data capture (CDC) scenario is not supported by Fabric Copy. As a workaround the usage of the Lakehouse SQL endpoint in an SQL connector instead. I requested to be informed, when the Fabric Copy supports CDC tables.
ajaroraMicrosoft Employee
We are bringing support to do CDC based ingestion via CopyJob artifact. This is in Private Preview, and we will go live soon. Please DM me for any more details.
