[Libreoffice-bugs] [Bug 131312] calc: funny / odd / wrong display of value in scientific format

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=131312

--- Comment #3 from b. <newbie-02 at gmx.de> ---
there is an easier way to reproduce: 

the value which is erroneously presented is: 

'1' that's what the mantissa values should - nearly - add up to, 

minus '2^-52' (for the missing terms 2^-53, 2^-54, 2^-55 ... of the mantissa,
in infinite they should add up to 2^-52), 

minus '2^-51', that's the bit not set in the sample, 

thus '1 - 2^-52 - 2^-51' should be the same value, and might show the same
weakness when displayed in scientific format, and, voila, it does. 

easy reproducer: copy and paste '=1 - 2^-52 - 2^-51' in a cell, without the
quotes, and then set the format to 'scientific' with 14 or more decimal places. 

fault: with ver. 6.2.8.2 and 7.0.0.0.a0+ : display of 10,00000000000000E+00 

(my assumption - sorry @Eike - somewhere a '< vs. <=' or '> vs. >=' error ...
in the code to format the display)

i saw some other issues with bits from the mantissa having no effect on the
fraction or final value, i'll ask for that in 'ask' first. 

reg. 

b.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200328/bfd6c367/attachment.htm>