[Libreoffice-bugs] [Bug 131312] calc: funny / odd / wrong display of value in scientific format
bugzilla-daemon at bugs.documentfoundation.org
bugzilla-daemon at bugs.documentfoundation.org
Mon Mar 30 09:46:12 UTC 2020
https://bugs.documentfoundation.org/show_bug.cgi?id=131312
b. <newbie-02 at gmx.de> changed:
What |Removed |Added
----------------------------------------------------------------------------
Version|6.2.8.2 release |Inherited From OOo
--- Comment #5 from b. <newbie-02 at gmx.de> ---
@Regina: yeah, thanks, i think it's the same bug,
an old bug again :-(
still unresolved in AOO?
already buggy in LO 4.1.6.2, setting to 'inherited from OOo',
could someone check in linux please?
looks as if
correct display 'til:
1-7,21644966006352E-016,
wrong display starting with:
1-7,21644966006351E-016,
wrong display 'til:
1-6,10622663543837E-016,
display correct again starting with:
1-6,10622663543836E-016
in IEEE 754 notation (sign(1) - exp(11) - mantissa(52)):
0 0 1111111110 11 1111111111 1111111111 1111111111 1111111111 1111111001 holds,
0 0 1111111110 11 1111111111 1111111111 1111111111 1111111111 1111111010 fails,
0 0 1111111110 11 1111111111 1111111111 1111111111 1111111111 1111111011 holds,
same for negative values,
1 0 1111111110 11 1111111111 1111111111 1111111111 1111111111 1111111010 fails,
binary formula to construct affected value: '=(1+(1-2^-52)-2^-50-2^-52)*2^-1'
wrong display occuring in a range of +/- 2^-53 around this value,
sometimes values are shown correct after load of file (despite 'recalc on load'
not! being set), but become wrong after re-entering the formula,
sorry for assumptions, it's not sure to be a LO bug, might also result from:
- intel (hardware),
- intel (software / library),
- gnu c++,
- gnu c++ compiler options (i've seen a site saying that performance options
have evil affect on fp precision ...)
[we have two of ~ 1,843*10^19 values producing a misrepresentation, and i have
to stumble upon one of them ... who has given me this 'talent'? and why?]
--
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200330/a5c7a375/attachment.htm>
More information about the Libreoffice-bugs
mailing list