Bug in CopyData appending to partitioned table

coolie — Wed, 29 Nov 2023 15:16:47 GMT

I can create a lakehouse partitioned table by selecting Overwrite in the destination options and choosing a column for the partition (simplified for this post):

Result:

The behaviour I expected for subsequent runs was one of the following:

Keep as Overwrite - a partition with the same ID has data overwritten, but new partitions are created for new IDs, OR
Change to Append - a partition with the same ID has data appended, but new partitions are created for new IDs.

Neither of these happens - 1) just overwrites everything and 2) gives an error - so how are you supposed to update a partitioned table? This is the error for Append:

"ErrorCode=TableActionNotSupportAppendToPartitionedTable,

'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,

Message=Table action 'Append' is not supported for writing into existing partitioned table."

Re: Bug in CopyData appending to partitioned table

v-cboorla-msft — Thu, 07 Dec 2023 10:37:51 GMT

Hi coolie

This is a duplicate thread of the similar one available at the link : Duplicate Link
Hence I am closing this thread.

Thanks.

topic Bug in CopyData appending to partitioned table in Pipelines

Bug in CopyData appending to partitioned table

Re: Bug in CopyData appending to partitioned table