[Libreoffice-bugs] [Bug 37923] Improve Calc precision when subtracting large integers to parity with Excel
bugzilla-daemon at bugs.documentfoundation.org
bugzilla-daemon at bugs.documentfoundation.org
Mon Sep 28 23:00:30 UTC 2020
https://bugs.documentfoundation.org/show_bug.cgi?id=37923
b. <newbie-02 at gmx.de> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |newbie-02 at gmx.de
--- Comment #18 from b. <newbie-02 at gmx.de> ---
fine so far, but now try 1,2 instead of 1 in B1 and see '0' as result,
happens for all values from -2,8125 to +2,8125 except the integers -2, -1, 0,
1, 2
may result from different handling of integers (16 significant digits) against
floats (rounded / truncated to 15 significant decimal digits),
that rounding is too hard, maybe it's not necessary anymore, @Mike Kaganski
recently fixed an error in the string evaluation, tdf#130725, maybe rounding
was a try to hide such errors? then you could now handle integers and floats
with equal accuracy and avoid many irritations ...
or shall i file an enhancement request for that, 'integers and floating point
values (decimal fractions) should be displayed and evaluated with equal
accuracy to avoid irritation',
or does anybody know a reason why rounding of floats to less precision than
possible is neccessary?
besides ... ex$el does better ... :-(
--
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200928/6063d715/attachment-0001.htm>
More information about the Libreoffice-bugs
mailing list