Strange behaviour when deducting decimal numbers - precision issues?
Hi Anonymous,
I got information below:
"This is by design and here is the explanation: The operations listed in the incident are over decimal numbers. Power BI follows the IEEE Standard for Floating-Point Arithmetic (IEEE 754) in its support of decimal numbers as double-precision floating point numbers. Double-precision floating point numbers cannot represent all real numbers precisely in computer hardware therefore math calculations involving imprecisely represented real numbers can have rounding errors in high precision. To ensure comparison operations to return expected results, the user can either change the original column data type to fixed decimal numbers or modify the calculations to compensate for the lack of precision of representation of real numbers. For example, it's common practice for programmers to write ABS(a - b) < 1E-6 instead a = b when a and b are double-precision floating point numbers."
Best Regards,
Qiuyun Yu