[Libreoffice-bugs] [Bug 108690] Incorrect result for len function for large numbers
bugzilla-daemon at bugs.documentfoundation.org
bugzilla-daemon at bugs.documentfoundation.org
Mon Jun 26 19:24:50 UTC 2017
https://bugs.documentfoundation.org/show_bug.cgi?id=108690
Eike Rathke <erack at redhat.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|UNCONFIRMED |RESOLVED
Resolution|--- |NOTABUG
--- Comment #3 from Eike Rathke <erack at redhat.com> ---
Note that after step 7 above (appending a zero), going back to cell A1 the
input line changed to 1.8014398509482E+016 which is the length calculated in B2
as LEN() always calculates the "raw" input number, not the formatted number.
The reason is that with appending a zero digit the number runs into a magnitude
where the double floating point loses precision, ie. it can not be
distinguished between 18014398509482000 and 18014398509482001, for example.
However, the display format for A1 forces the number to be displayed using a
non-exponential notation, note that it will display 18014398509482000 also for
18014398509482009 ...
The maximum representable integer is (2^53)-1 or 9007199254740991.
--
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20170626/87963971/attachment.html>
More information about the Libreoffice-bugs
mailing list