[Libreoffice-bugs] [Bug 138920] Precision issue in calc

bugzilla-daemon at bugs.documentfoundation.org bugzilla-daemon at bugs.documentfoundation.org
Fri Dec 18 23:05:24 UTC 2020


https://bugs.documentfoundation.org/show_bug.cgi?id=138920

--- Comment #11 from Eike Rathke <erack at redhat.com> ---
You seem to not understand. Once the value is in the IEEE 754 binary format
there are no "8 decimal places" to use.

It's about sufficient precision and rounding when converting from binary
floating-point to the decimal display string.

See also https://erack.de/bookmarks/D.html#010203
Or if you want to dive deep into then
https://erack.de/bookmarks/D.html#Computer_Arithmetic_and_IEEE_754

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20201218/967a6a6f/attachment.htm>


More information about the Libreoffice-bugs mailing list