Calc solvers - what to say in the Calc Guide

Mon May 18 09:17:04 UTC 2020

Drew,

Many thanks for your efforts in trying to get to the bottom of this.

I think that putting the information on the wiki is a good idea. The
relevant chapter of the Calc Guide (Chapter 9, Data Analysis) is already
very thick and would not benefit from being expanded further to include
more solver details.

Regards,

Steve

On Mon, 18 May 2020 at 06:39, Drew Jensen <drewjensen.inbox at gmail.com>
wrote:

> HI,
>
> Well, I noticed something aside from the Guide and that is the FAQ
> over on the wiki.
> https://wiki.documentfoundation.org/Faq/Calc/109/fr
> Now, it turns out that the French version of that FAQ points to a page
> (first link on the page) on the TDF wiki but none of the other
> languages do. They point back to the AOO wiki and on that wiki page it
> has links to things like extensions LibreOffice doesn't need and API
> documentation in AOO SDK.
>
> So - I thought why not steal the content from the AOO page as a start
> of a TDF page (or PDF maybe ;-).
>
> I did that and then I updated a few things in it. Not done updating
> things, but done for tonight.
>
> You can review a draft of this
> https://nextcloud.documentfoundation.org/s/ebisHjZo2rowM4Q
>
> Can see some easy edits in the top part of the text and I need to ask
> for help filling in the information for scripting as needed for the
> additional algorithm engines in LO - for one thing maybe a bit more.
>
> Anyway, any feedback is welcome. Will post tomorrow when those changes
> are made.
>
> Thanks,
>
> Drew
>
> On Sat, May 16, 2020 at 7:31 PM Drew Jensen <drewjensen.inbox at gmail.com>
> wrote:
> >
> > This is an interesting point of differentiation.
> > Reviewing some of the tools yesterday and this morning;
> > AOO with 1 solver engine in default install (4.2 pre-release binary);
> >
> > OnlyOffice (latest desktop Linux binary) has no Solver equivalent in
> > either the desktop binary or the cloud version, not that I can find
> > (didn't see any in the available plug-ins, but maybe their is
> > something behind the paywall areas).
> >
> > WSP (May 2020 release) includes only one, a simplex linear solver.
> >
> > MS 365 and Google Sheets both require an plug-in, Frontline Systems
> > Inc looks to be the leading supplier for both tools, but there are
> > multiple other choices for each.
> >
> > Looking at this the first couple sentences, "The standard Microsoft
> > Excel Solver uses a basic implementation of the primal Simplex method
> > to solve LP problems.  It is limited to 200 decision variables.", from
> > this web page https://www.solver.com/linear-quadratic-technology and
> > thinking that we should be able to run down answers to some of the
> > bounds information for the different engines also.
> >
> > Below are the different options sets for the engines.  Most
> > specifically give bounds (ie Epsilon Level), but a few don't (ie
> > Learning Cycles); I don't know if it would be worth it to get those
> > numbers or not.
> >
> > I think it is worth it to, per engine, list these in the guide/help
> > file. It is a lot easier to highlight something like "ACR Comparator
> > (instead of BCH)" from a PDF/HTML then from that dialog box in the
> > application so that you can do a DDG search on the term ;)
> >
> > LibreOffice CoinMP Linear Solver & LibreOffice Linear Solver
> > Options
> > - Assume variables as integers. (Default FALSE)
> > - Assume variables as non-negative. (Default FALSE)
> > - Epsilon Level 0-3. (Default 0)
> > - Limit branch and bound depth. (Default FALSE)
> > - Solving time limit (seconds). (Default 100)
> >
> > DEPS Evolutionary Algorithm
> > Options
> > - Agent Switch Rate (DE Probability): (Default .05)
> > - Assume non-negative variables (Default FALSE)
> > - DE: Crossover Probability (0-1): (Default 0.9)
> > - DE: Max Scaling Factor (0-1.2): (Default 0.5)
> > - DE: Min Scaling Factor (0-1.2): (Default 0.5)
> > - Learning Cycles: (Default 2000)
> > - PS: Cognitive Constant: (Default 1.494)
> > - PS: Mutation Probability (0-0.005): (Default 0.729)
> > - PS: Social Constant: (Default 1.494)
> > - Show enhanced solver status (Default TRUE)
> > - Size of library; (Default 210)
> > - Size of swarm; (Default 70)
> > - Stagnation limit: (Default 70)
> > - Stagnation tolerance: (Default 0.0000001)
> > - Use ACR Comparator (instead of BCH). (Default FALSE)
> > - Use random starting point. (Default FALSE)
> > - Variable bounds testing. (Default TRUE)
> > - Variable bounds threshold (when guessing): (Default 3)
> >
> > SCO Evolutionary Algorithm
> > Options
> > - Assume variables as non-negative. (Default FALSE)
> > - Learning Cycles: (Default False)
> > - Show enhanced solver status (Default TRUE)
> > - Size of library; (Default 210)
> > - Size of swarm; (Default 70)
> > - Stagnation limit: (Default 70)
> > - Stagnation tolerance: (Default 0.0000001)
> > - Use ACR Comparator (instead of BCH). (Default FALSE)
> > - Use random starting point. (Default FALSE)
> > - Variable bounds testing. (Default TRUE)
> > - Variable bounds threshold (when guessing): (Default 3)
> >
> > LibreOffice Swarm Non-Linear Solver (experimental)
> > Options
> > - Assume variables as integers. (Default FALSE)
> > - Assume variables as non-negative. (Default FALSE)
> > - Solving time limit (seconds). (Default 6000)
> > - Swarm algorithm (0 - Differential Evolution, 1 - Particle Swarm
> > Optimization): (Default 0)
> >
> > Saw your mail about the version 7 Guide, but already had that typed in
> > so figured I'd send it along anyway.
> >
> >
> > On Sat, May 16, 2020 at 5:22 PM Drew Jensen <drewjensen.inbox at gmail.com>
> wrote:
> > >
> > > Well here is something
> > > Looking at the help file for version 7
> > >
> https://help.libreoffice.org/7.0/en-US/text/scalc/01/solver.html?&DbPAR=CALC&System=UNIX
> > > the final text box states that 'only linear solvers are in the default
> installation'.
> > >
> > > However 7.0 Alpha1 build adds a choice of, 'LibreOfficeDev Swarm
> non-linear Solver (experimental)' for an engine.
> > >
> > > So, assuming that engine ships with 7 the text box in the help file
> could go.
> > >
> > >
> > >
> > > On Fri, May 15, 2020 at 7:02 AM Stephen Fanning <
> stevemfanning.wh at gmail.com> wrote:
> > >>
> > >> Kohei and Drew,
> > >>
> > >> Many thanks for getting back to me on this topic.
> > >>
> > >> For the 6.4 update to the Calc Guide, I will follow Kohei's advice
> that it is probably beyond the scope of the document to provide guidance on
> how to select a solver.
> > >>
> > >> I'll try to make some time before the 7.0 Calc Guide update to
> re-visit this decision.
> > >>
> > >> Regards,
> > >>
> > >> Steve
> > >>
> > >>
> > >> On Fri, 15 May 2020 at 07:40, Drew Jensen <drewjensen.inbox at gmail.com>
> wrote:
> > >>>
> > >>> Tonight took the LO 7 alpha1 file and the one example workbook from
> that Excel tutorial and ran each of the five solver engines.
> > >>> For sure the LO CoinMP and LO Linear choices are crazy faster then
> DEPS and SCO (The firth choice Swarm non-linear is just as quick but the
> results are kaka, but it does say it is experimental).
> > >>>
> > >>> On Thu, May 14, 2020 at 7:55 PM Drew Jensen <
> drewjensen.inbox at gmail.com> wrote:
> > >>>>
> > >>>> hmm - there are bits and pieces here and there.
> > >>>>
> > >>>> For example the first two choices (DEPS & SCO) have some
> explanation over at AOO wiki
> > >>>> https://wiki.openoffice.org/wiki/NLPSolver
> > >>>> If that is still relevant for LibreOffice I can't say, but likely.
> > >>>> CoinMD (which I assume here is type of Coin-MP) has a lot of
> generalized references, even a wiki page with a paragraph or two that might
> be worth drafting for service here:
> > >>>> https://en.wikipedia.org/wiki/COIN-OR
> > >>>>
> > >>>> anyway - I'm just using DDG to search for info on the different
> solver types, and you get the idea.
> > >>>>
> > >>>> There is a couple of examples of tutorials the reference solvers in
> Calc (one of which actually uses the same example data to show how to solve
> both in Excel and Calc), but the couple I reviewed only use one as an
> example.
> > >>>>
> > >>>> I did find one for Excel that has an over view which I thought was
> a decent balance of information on the three solver models available there
> at:
> > >>>>
> https://www.tutorialspoint.com/excel_data_analysis/advanced_data_analysis_optimization_with_excel_solver.htm
> > >>>>
> > >>>> IDK if any of the helps, hope it does.
> > >>>>
> > >>>> Best wishes,
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> On Thu, May 14, 2020 at 7:19 PM Kohei Yoshida <
> kohei at libreoffice.org> wrote:
> > >>>>>
> > >>>>> On 10.05.2020 10:59, Stephen Fanning wrote:
> > >>>>>
> > >>>>> > What guidance can I insert into the Calc Guide to help the user
> if he
> > >>>>> > wonders which algorithm to select?
> > >>>>>
> > >>>>> This is strictly my personal opinion.
> > >>>>>
> > >>>>> Which optimization solver to pick really depends on the
> characteristics
> > >>>>> of the data being optimized, how (well) the algorithm is
> implemented in
> > >>>>> the versions included in Calc, the accuracy goal etc. etc.  It's
> more an
> > >>>>> art than science, and each user really needs to experiment with
> various
> > >>>>> solvers to see which one works best for his or her optimization
> cases.
> > >>>>> My personal opinion is that it is probably beyond the scope of
> Calc user
> > >>>>> guide to provide any sort of guidance on how to select a solver.
> > >>>>>
> > >>>>> Feel free to disagree with me on this.  I'm not an expert. :-)
> > >>>>>
> > >>>>> Kohei
> > >>>>> _______________________________________________
> > >>>>> LibreOffice mailing list
> > >>>>> LibreOffice at lists.freedesktop.org
> > >>>>> https://lists.freedesktop.org/mailman/listinfo/libreoffice
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/libreoffice/attachments/20200518/5f16e757/attachment.htm>