Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
HennSarv
Helper I
Helper I

question about precision

I've created some small tests about precision and one point I don't get

HennSarv_0-1607584485341.png

why the result end with 1 not with 3.

A bit surpriced
Henn Sarv

3 REPLIES 3
v-yingjl
Community Support
Community Support

Hi @HennSarv ,

In power query, the largest precision that can be represented in a Decimal Number type is 15 digits long. The decimal separator can occur anywhere in the number. The Decimal Number type corresponds to how Excel stores its numbers.

Please refer: Data types in Power Query 

You can also refer this similar issue: Decimal Values Precision 

 

Best Regards,
Community Support Team _ Yingjie Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

YEs I undestand this fine - My question is about last funcy number on "rounded" result

When You look my example - there ise 2 numbers with lot of 1-s and 2-s after comma
when You preserve only 15 digits - You get:

0.111111111111111
0.222222222222222
sum on those much be

0.333333333333333
but looks like
0,33333333333333331

1st - there is 17 numbers after and result must finish with 3 not with 1

actualli 

0.11111111111111111 // 17 digits
+
0.22222222222222222
produces 0,33333333333333331


MattAllington
Community Champion
Community Champion

Possibly because a has 2 extra characters than b?



* Matt is an 8 times Microsoft MVP (Power BI) and author of the Power BI Book Supercharge Power BI.
I will not give you bad advice, even if you unknowingly ask for it.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.

Jan25PBI_Carousel

Power BI Monthly Update - January 2025

Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.

Jan NL Carousel

Fabric Community Update - January 2025

Find out what's new and trending in the Fabric community.