Forum Discussion

debiagui's avatar
debiagui
Resolver I
4 years ago
Solved

Precision in Power Query number data type

I've a dataflow with material master data and his net weight in kilogrames, the source is an excel in a sharepoint, the Net Weight is saved in number data type.
Then I use this dataflow in another one to convert the Sales in units to Tons using a power query formula like
= Units * [Net Weight] /1000 (the new calculated column is saved also in number data type) but for a small products the result losess some decimals, seams like there was some round in the power query background.
Some one knows about the precision in number data type?
Sample:
Sales In units = 5, Net Weight of the product in TONS 0.000048, Result of the new column  = 0, but the real result it's 0.00024
Or maybe is a bug?
  • Anonymous's avatar
    Anonymous
    4 years ago

    Hi debiagui ,

     

    Based on my test:

    If you are in the same case, please change the Format from General to Scientific as shown below:

     

    Best Regards,
    Eyelyn Qin
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

1 Reply

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi debiagui ,

     

    Based on my test:

    If you are in the same case, please change the Format from General to Scientific as shown below:

     

    Best Regards,
    Eyelyn Qin
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.