[Libreoffice-bugs] [Bug 123408] the sum of this selection is wrong, an offset of 1/100.

bugzilla-daemon at bugs.documentfoundation.org bugzilla-daemon at bugs.documentfoundation.org
Tue Feb 12 15:59:02 UTC 2019


https://bugs.documentfoundation.org/show_bug.cgi?id=123408

--- Comment #2 from Eike Rathke <erack at redhat.com> ---
That is due to loss of precision when using the IEEE 754 floating point format.
All computer software not using binary coded decimals or other means to correct
precision round-offs suffers from it. See
http://0.30000000000000004.com/
https://en.wikipedia.org/wiki/Numeric_precision_in_Microsoft_Excel
https://www.microsoft.com/en-us/microsoft-365/blog/2008/04/10/understanding-floating-point-precision-aka-why-does-excel-give-me-seemingly-wrong-answers/

If you format the cells involved to two decimals, for example 0.00 then that
format will be used in the status bar as well and the result displayed
accordingly rounded.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20190212/523799a9/attachment.html>


More information about the Libreoffice-bugs mailing list