[Libreoffice-bugs] [Bug 138920] Precision issue in calc

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=138920

--- Comment #6 from Jonny Grant <jg at jguk.org> ---
(In reply to Uwe Auer from comment #4)
> (In reply to Jonny Grant from comment #2)
> 
> > 
> > Google Docs and Excel don't have this bug.
> 
> Don't call it a bug. Probably Google Sheets and Excel perform some rounding
> based on some unknown idea. It's ok to request a change in arithmetic of the
> application, but it is not ok to call correct IEEE 754 calculation a bug.

Firstly, thank you for your reply.

As software developers, like yourself Uwe, I think we all understand IEEE
floating point, double precision, rounding etc.

Calc is a program for users, who do sums, for accounting etc.

9.25178559 has 8 digits of decimal precision,  8.9818 has 4.
Of course, every piece of software knows the result would only have 8 digits of
precision.  It's appropriate to display only 8 digits, by whatever rounding
Calc needs to do.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20201215/28dfd98b/attachment.htm>