topic Re: Problem with Data Pipeline, Mysql column type of decimal in Pipelines

Problem with Data Pipeline, Mysql column type of decimal

cduden — Wed, 15 May 2024 20:34:42 GMT

Attempting to set up a simple Copy data activity from our MySQL db. I'm trying to copy one table but when I get to the mapping step it says the column "krivalue" has an unsupported type. The type is decimal(50,2) in MySQL. I've looked around on the interwebs but no joy.

The schema in MySql:

Any ideas re. what is wrong here?

Thanks.

Re: Problem with Data Pipeline, Mysql column type of decimal

v-cboorla-msft — Thu, 16 May 2024 06:37:52 GMT

Hi cduden

Thanks for using Microsoft Fabric Community.

In MySQL database the maximum total number of decimal digits to be stored. This number includes both the left and the right sides of the decimal point. The precision must be a value from 1 through the maximum precision of 38.

For more details please refer : decimal and numeric (Transact-SQL).

Try to reduce the precision value of the decimal and execute the pipeline Copy activity.

If the issue still persist, please do let us know. Glad to help.

I hope this information helps.

Thank you.

Re: Problem with Data Pipeline, Mysql column type of decimal

v-cboorla-msft — Fri, 17 May 2024 16:07:44 GMT

Hi cduden

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

Thanks.

Re: Problem with Data Pipeline, Mysql column type of decimal

cduden — Fri, 17 May 2024 17:16:17 GMT

The link you provided applies to SQL Server (and other MS platforms) not to MySQL. MySQL allows for more precision: MySQL :: MySQL 8.0 Reference Manual :: 14.24.2 DECIMAL Data Type Characteristics

I assume this means that the Data Pipeline tool only accepts up to 38 points of precisions?

Thanks.

Re: Problem with Data Pipeline, Mysql column type of decimal

v-cboorla-msft — Mon, 20 May 2024 17:22:41 GMT

Hi cduden

Yes, In Microsoft Fabric Pipelines, the behavior is slightly different. While it leverages underlying data storage solutions like Azure Synapse or SQL Server, there isn't a direct equivalent for setting the maximum precision for decimals within the pipeline itself.

These underlying data platforms support a maximum precision of 38 for the decimal data type. This means Fabric Pipelines will work with decimals up to 38 digits when interacting with these data stores.

I hope this information helps. Please do let us know if you have any further queries.

Thank you.

Re: Problem with Data Pipeline, Mysql column type of decimal

v-cboorla-msft — Tue, 21 May 2024 16:04:01 GMT

Hi cduden

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

Thanks.

Re: Problem with Data Pipeline, Mysql column type of decimal

cduden — Tue, 21 May 2024 17:54:25 GMT

Reducing the precision of the source column in MySQL did fix the problem. Thanks for your help.