[Libreoffice-qa] automation tool for smoke test qa. (alpha)

[Alexander Thurgood]

Hey this looks good, I'll be trying this out when I've got a regular
internet connection again next week, but it'll be on Mac.

Alex

Le 4 août 2011 10:14, "Yifan Jiang" <yfjiang at novell.com> a écrit :

Dear fellow QA,

We've been working on a full automatic test tool aiming on continuously
testing the latest libreoffice build from <dev-build.libreoffice.org>.
Namely
the script wants to help you check, download, install and do some very basic
somketest on the latest build.

The current downloadable tool is here:

http://dev-builds.libreoffice.org/daily/losmoketest-0.2.tar.bz2

It is still in develpment phase, but I would like to share this at the
moment
for your information. If interested, would you read through the following,
find a machine and run the tool. Your ideas, feedbacks, requirements and
contribution are very welcome.

Any bugs report/feature requests, please let me know via email for now (I'll
handle bug report in bugzilla after the tool is push to git).

The mailing list will be informed when new versions come (soon).

Background
==========

The tool is designed to be availble working with both daily and pre release
build located in dev-build.libreoffice.org.

The purpose of daily build testing is obvious, we want to catch bugs as
early
as possible:) some ideas canbe found here:


http://wiki.documentfoundation.org/Testing_Daily_Builds#Is_parallel_installation_possible_.2F_planned.3F

For the purpose of smoketest for pre release testing, currently there is an
about 24 hrs lag syncing RC build from dev-build to official site. We need
to
guarantee at least the very basic function working before more people
download
the RC build from official site and play with it, in as short as 24 hrs.

The tool is named as losmoketest for its purpose, meanwhile it help you to
check, download and install the latest build. By the fact the installation
is
designed not to be different from manually doing these repeated work, the
installed libreoffice build can also be good for manual test.

The tool
========

[Prerequisite]

   - Python > 2.6
       http://www.python.org/download/

   - A machine free to play (The test may *override* your existed
   libreoffice3.4 installation).

   - On Linux, add the following line in /etc/sudoer:

       $USER   ALL=(ALL) NOPASSWD: ALL

     where $USER is your real user name. With this line, every command
     initialed with `sudo` will not be asked to input a password. Please
     consider by yourself the security risk brought by it.

[Features Availability]

   Full features are implemented on Linux x86 and x86_64, rpm and deb:

       - Checking and dowloading the latest build
       - Install the latest build
       - Run smoke test on the build (not stable)

   Partial features are implemented on Windows:

       - Checking and dowloading the latest build
       - Install the latest build (Thanks *blip* help find out the command
for silent install)

   Partial features are implemented on Mac:

       - Checking and dowloading the latest build

[Usages]

   1. Test the latest pre releases build:

          $ cd /path/to/losmoketest
          $ ./losmoketest.py                 # Test the latest pre releases
build:
          $ ./losmoketest.py -t daily_master # Test the latest daily master
build
          $ ./losmoketest.py -t daily_branch # Test the latest daily branch
build (now 3.4)

   2. Just Install the latest LOCAL build:

          $ cd /path/to/losmoketest
          $ ./losmoketest.py -i                  # Install the latest pre
releases build in losmoketest/_download
          $ ./losmoketest.py -i -t daily_master  # Install the latest daily
master build in losmoketest/_download
          $ ./losmoketest.py -i -t daily_branch  # Install the latest daily
branch build (now 3.4) in losmoketest/_download

   3. Just Verify the installed build:

          $ cd /path/to/losmoketest
          $ ./losmoketest.py -v

   4. More tips in:

          $ cd /path/to/losmoketest
          $ ./losmoketest.py -h

[Tested on]

   - SLED 11 sp1 x86
   - SLED 11 sp1 x86_64
   - OpenSuSE 11.4 x86
   - Ubuntu 10.10 x86

[TODO]

   1. verify_smoketest() improvement (replace it with more simple script
     rather than complicated cppunittester)

   2. add logging system

   3. 'git' it when we have a stable code base

   4. handling mac and windows build

[Known issue]

   1. The cppunittest performs not quite stable in different libreoffice
      build, some times it just hangs there without noticing :(

   2. The version tag is desired to get dynamically. The current hard coded
      3.4 is not reliable, especially not reliable when verify_smoketest()
      tries to set LD_LIBRARY_PATH.

   3. Parallel installation with official build has a dependancy on
Tinderbox
      improvement (the dev-build is ideally to be installed on something
like
      /opt/lo-dev).

Best wishes,
Yifan

--
 Yifan Jiang
 Libreoffice / SuSE
 Contact: yifan - irc.freenode.net/libreoffice
 =============================================
 http://www.libreoffice.org/
 http://www.documentfoundation.org/

_______________________________________________
List Name: Libreoffice-qa mailing list
Mail address: Libreoffice-qa at lists.freedesktop.org
Change settings:
http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems?
http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/libreoffice-qa/attachments/20110804/7657f9d4/attachment-0001.html>