[Libreoffice-bugs] [Bug 129606] Drag-fill series produces values like 6.00000000000001

[bugzilla-daemon at bugs.documentfoundation.org]

https://bugs.documentfoundation.org/show_bug.cgi?id=129606

--- Comment #6 from b. <newbie-02 at gmx.de> ---
Created attachment 156935
  --> https://bugs.documentfoundation.org/attachment.cgi?id=156935&action=edit
IEEE 754 values handeled in calc

hello @Mike, 

happy new year, 

i already admitted that my comment may be valueless for you, but might be
usefule for others less experienced, 

your sample: 

1.1 - 1.0 => ~0.10000000000000009
0.1       => ~0,10000000000000001

is a little 'off' in two respects: 

- it's likely ~0.10000000000000001 - with a dot, 

- and it's handled different in calc, both results 0.10000000000000000000, see
attached screenshot, 

that may result from the 'valueless placeholders' you supressed with the
valueless comment, 

thanks for correcting the citation, 

regardless of your rough tone i will be happy if you succeed in making this
little piece of calc working smooth for users without breaking functionality or
correctness ... 

reg. 

b.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice-bugs/attachments/20200105/a3fe4d1c/attachment.htm>