[Libreoffice-bugs] [Bug 39293] Big integers do not subtract correctly

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=39293

--- Comment #7 from b. <newbie-02 at gmx.de> ---
sorry for stepping into an old bug, just for clarification: 

the values in the sample sheet are not integers, but display strings for
rounded calculation results, a square of a number ending in '5' should end in
'5', thus '25' instead of the '30', and a result from xxx6 * yyy7 * 4 / 2
should end in '4', thus 1491038293021224 instead of the rounded
1491038293021220, 

(nobody spotted that?) 

old versions of calc did more wrong rounding than recent, but as we deal with
'floats' there is no guarantee, 

in most situations calc keeps more precise values internally for calculation, 

starting from that point it's clear that calc's calculation will deviate from
users expectation, 

another erro:, as calc and all spreadsheets are limited in the storage for a
number there will always be a biggest integer, taken that and added something
will result in a value which needs another format to store, with probably less
precision, leading to results deviating from users expectations, 

21 decimal digits i've never seen in calc,

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200928/3849b3ca/attachment.htm>