topic Re: Unreported column about a String or binary data would be truncated error in Dataflow

Unreported column about a String or binary data would be truncated error

pmscorca — Tue, 09 Jul 2024 13:51:17 GMT

Hi,

when I execute a dataflow gen2 to read data from a lakehouse to write them on a warehouse I've this error message:

Mashup Exception Data Source Error Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Microsoft SQL: String or binary data would be truncated.
Statement ID: {926CA275-B4F8-4391-B7A7-2560D413926A} | Query hash: 0x90C540A1118FAC5C | Distributed request ID: {0988B236-747B-49C3-8869-6ADCDCF060FD} Details: Reason = DataSource.Error;DataSourceKind = Warehouse;DataSourcePath = Warehouse;DataSourceKind.2 = SQL;DataSourcePath.2 = qmxec46aaygu5ksudatjigps5u-h7quefgbrgluflsuz3rki4qzai.datawarehouse.fabric.microsoft.com;xxxxWH_test;Message = String or binary data would be truncated.
Statement ID: {926CA275-B4F8-4391-B7A7-2560D413926A} | Query hash: 0x90C540A1118FAC5C | Distributed request ID: {0988B236-747B-49C3-8869-6ADCDCF060FD};ErrorCode = -2146232060;Number = 8152;Class = 16;State = 14;Microsoft.Data.Mashup.Error.Context = User

So, how could I detect the unreported column in the message? Thanks

Re: Unreported column about a String or binary data would be truncated error

NandanHegde — Wed, 26 Jun 2024 03:13:15 GMT

Based on my understanding, it is not possible to get that data from the failure meassage.

You would have to debug via the below scenarios :

1) you would have to compare the max length of values of each column at source with the schema at the sink

to identify for which column the data is getting truncated

2)try making the length of all columns max and then insert data and then compare the max value length with original column lengths

Re: Unreported column about a String or binary data would be truncated error

pmscorca — Wed, 26 Jun 2024 07:39:38 GMT

Hi, thanks for your reply but your suggest is a workaround similar to I do.

Using a data pipeline I can see also the wrong column name in the error message, so I think that unreporting the wrong column is a lack in dataflow gen2.

Thanks

Re: Unreported column about a String or binary data would be truncated error

frithjof_v — Wed, 26 Jun 2024 19:07:04 GMT

If you want the column name to be added in this error message, I guess you will need to submit it as an idea here: https://ideas.fabric.microsoft.com/

Or create a support ticket.

I agree, the column name should be visible in the error message. That would be a lot more user friendly experience.

Re: Unreported column about a String or binary data would be truncated error

pmscorca — Wed, 03 Jul 2024 05:28:11 GMT

Hi, I think that a such lack should be obvious without submitting an idea or creating a support ticket.

Re: Unreported column about a String or binary data would be truncated error

pmscorca — Wed, 10 Jul 2024 15:27:08 GMT

Hi,

I've submitted this idea Reporting the column that causes a String or binary data would be truncated error
Please vote it, thanks