LO calc formulas

Dante Doménech dante19031999 at gmail.com
Wed Dec 9 23:25:36 UTC 2020


OK. Thanks you. Found it.
In base to the code is feasible in a couple of weeks.
I-ll implement a second order kahan algorithm. Third order would be
overkill ( I don't think anyone is gonna use it for high precision
calculus  ).
But it's not only sum and average, variance (stats) and any other formula
with sums is affected. That's why I need time to track it.
And by the way, what about using long double for intermediate steps, to
improve precision. For what I know glibc or whatever uses gcc on fedora
uses it, or at least exp((double)10) returns the same as exp((long
double)10.

El mié, 9 dic 2020 a las 23:00, Eike Rathke (<erack at redhat.com>) escribió:

> Hi,
>
> On Wednesday, 2020-12-09 20:25:17 +0100, Dante Doménech wrote:
>
> > Does anyone know where are implemented the calc formulas?
>
> Regina already gave pointers. Ask if you need more.
>
> > I'd like to check out if it uses the kahan algorithm, pairwise sum or
> > something else.
>
> Kahan is not used, but there's
> https://bugs.documentfoundation.org/show_bug.cgi?id=137679
> to implement it. I thought Roman would start on that but maybe
> I misunderstood. So if you'd like to tackle that you're welcome.
>
> The current approach is quite simple, it just remembers one value to add
> that later.
>
>   Eike
>
> --
> GPG key 0x6A6CD5B765632D3A - 2265 D7F3 A7B0 95CC 3918  630B 6A6C D5B7 6563
> 2D3A
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice/attachments/20201210/14206b27/attachment.htm>


More information about the LibreOffice mailing list