[Libreoffice-bugs] [Bug 37923] Improve Calc precision when subtracting large integers to parity with Excel

bugzilla-daemon at bugs.documentfoundation.org bugzilla-daemon at bugs.documentfoundation.org
Mon Sep 28 23:00:30 UTC 2020


https://bugs.documentfoundation.org/show_bug.cgi?id=37923

b. <newbie-02 at gmx.de> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |newbie-02 at gmx.de

--- Comment #18 from b. <newbie-02 at gmx.de> ---
fine so far, but now try 1,2 instead of 1 in B1 and see '0' as result, 
happens for all values from -2,8125 to +2,8125 except the integers -2, -1, 0,
1, 2

may result from different handling of integers (16 significant digits) against
floats (rounded / truncated to 15 significant decimal digits), 

that rounding is too hard, maybe it's not necessary anymore, @Mike Kaganski
recently fixed an error in the string evaluation, tdf#130725, maybe rounding
was a try to hide such errors? then you could now handle integers and floats
with equal accuracy and avoid many irritations ...  

or shall i file an enhancement request for that, 'integers and floating point
values (decimal fractions) should be displayed and evaluated with equal
accuracy to avoid irritation', 

or does anybody know a reason why rounding of floats to less precision than
possible is neccessary? 

besides ... ex$el does better ... :-(

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200928/6063d715/attachment-0001.htm>


More information about the Libreoffice-bugs mailing list