Forum Discussion

RuedigerThiel's avatar
RuedigerThiel
Frequent Visitor
1 year ago

Copy data failing for dataverse table

Hello, I'm try to setup a Copy data activity. I want copy the dirpartytable, but even the preview fails with an error 21446 and the message "Invalid table! Parquet column is not defined in delta meta...
Need Help
Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi RuedigerThiel 

 

Thank you very much FabianSchut for your prompt reply.

 

Please let us know if your issue is resolved. I look forward to you sharing the information you get!

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

RuedigerThiel's avatar
RuedigerThiel
Frequent Visitor
1 year ago

Hello everybody, here a short summary for the issue.

I have created a ticket TrackingID#2411061420002831 with the Microsoft Support. Currently the change data capture (CDC) scenario is not supported by Fabric Copy. As a workaround the usage of the Lakehouse SQL endpoint in an SQL connector instead. I requested to be informed, when the Fabric Copy supports CDC tables.

  • ajarora's avatar
    ajarora
    Icon for Microsoft Employee rankMicrosoft Employee
    1 year ago

    We are bringing support to do CDC based ingestion via CopyJob artifact. This is in Private Preview, and we will go live soon. Please DM me for any more details.

    • vivien57's avatar
      vivien57
      Icon for Super User rankSuper User
      1 year ago

      Hello ajarora 

      I would like to have the details please. So it won't be compatible via a copy data in a Data Pipeline?

      Thank you in advance for your feedback

      Vivien

    • RuedigerThiel's avatar
      RuedigerThiel
      Frequent Visitor
      1 year ago

      ajarora Can you enable us for the private preview? Pls adv  Brgds Rüdiger

    • vivien57's avatar
      vivien57
      Icon for Super User rankSuper User
      1 year ago

      Hello ajarora 

      Do you have any news, because the problem with the CDC seems to be still present on the copy job, I've just done the test.

      Thank you very much in advance,

      Have a nice day,

      Vivien

    • RuedigerThiel's avatar
      RuedigerThiel
      Frequent Visitor
      1 year ago

      Hello Vivien, I have no idea what might be the problem there. I assume you contact the microsoft support. 

      Brgds Rüdiger

      • vivien57's avatar
        vivien57
        Icon for Super User rankSuper User
        1 year ago

        Thank you for your feedback.

        But have you had any feedback from Microsoft on fixing the problem for tables with the CDC?