Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
HennSarv
Helper I
Helper I

question about precision

I've created some small tests about precision and one point I don't get

HennSarv_0-1607584485341.png

why the result end with 1 not with 3.

A bit surpriced
Henn Sarv

3 REPLIES 3
v-yingjl
Community Support
Community Support

Hi @HennSarv ,

In power query, the largest precision that can be represented in a Decimal Number type is 15 digits long. The decimal separator can occur anywhere in the number. The Decimal Number type corresponds to how Excel stores its numbers.

Please refer: Data types in Power Query 

You can also refer this similar issue: Decimal Values Precision 

 

Best Regards,
Community Support Team _ Yingjie Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

YEs I undestand this fine - My question is about last funcy number on "rounded" result

When You look my example - there ise 2 numbers with lot of 1-s and 2-s after comma
when You preserve only 15 digits - You get:

0.111111111111111
0.222222222222222
sum on those much be

0.333333333333333
but looks like
0,33333333333333331

1st - there is 17 numbers after and result must finish with 3 not with 1

actualli 

0.11111111111111111 // 17 digits
+
0.22222222222222222
produces 0,33333333333333331


MattAllington
Community Champion
Community Champion

Possibly because a has 2 extra characters than b?



* Matt is an 8 times Microsoft MVP (Power BI) and author of the Power BI Book Supercharge Power BI.
I will not give you bad advice, even if you unknowingly ask for it.

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors