[Libreoffice-bugs] [Bug 141614] EDITING: Calc shows incorrect SUM (deviation of 0.000000000002 added to/sub'd from total) in bottom right status bar

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=141614

--- Comment #10 from Mike Kaganski <mikekaganski at hotmail.com> ---
Created attachment 171164
  --> https://bugs.documentfoundation.org/attachment.cgi?id=171164&action=edit
A screenshot from Excel with sum shown with 12 decimals

(In reply to TheWebMachine from comment #9)
> Ex$el and other apps have been adding FPNs for aeons and seem to get
> it working right just fine.

No they don't. They have exactly the same problems. All of them (Excel, Google
Sheets, whatever). It is perfectly normal, that doing *discrete* math, you get
the result normal for *discrete* math. And spreadsheets are just that - tools
doing discrete math with binary 64-bit numbers fast. And they just don't have
things like "0.1" - so they are always doing correct math with what *they*
convert from your input. Whenever you enter '0.1', Calc, Excel, ... get not
0.1, but 0.1000000000000000055511151231257827021181583404541015625 (closest
binary representation), and they do the correct following math with *that*
number.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20210413/a465fa0e/attachment.htm>