[Libreoffice-bugs] [Bug 55960] Filling cells with incremental numbers – wrong numbers

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=55960

--- Comment #15 from Mike Kaganski <mikekaganski at hotmail.com> ---
(In reply to Eike Rathke from comment #14)
> In the Input Line.

Ah yes, sorry. Blind me; must had missed that because of being tired in the
evening :-)

I don't think we need to limit the precision of calculation of the increment
here. The call in approxDiff is

> return rtl::math::round(0.050000000000000044, 15);

and it returns 0.050000000000000003, which is the closest binary representation
to 0.05 (see
https://www.binaryconvert.com/result_double.html?decimal=048046048053 ) - i.e.,
no additional limiting would improve this.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200224/2a4a2033/attachment.htm>