[Laszlo-dev] For Review: Change 20070702-ben-8 Summary: improvements to runlztest to run more tests, more quietly

[Benjamin Shine]

Change 20070702-ben-8 by ben at bens-g5.local on 2007-07-02 14:47:12 PDT
     in /Users/ben/src/svn/openlaszlo/branches/legals-clean
     for http://svn.openlaszlo.org/openlaszlo/branches/legals

Summary: improvements to runlztest to run more tests, more quietly

New Features:

Bugs Fixed: LPP-4236 runlztest should run to completion, not bail on  
first failure

Technical Reviewer: hqm (pending)
QA Reviewer: mkratt (pending)
Doc Reviewer: (pending)

Documentation:
This change tweaks build-tools/runlztest.sh to be less verbose about
standard operations, and to run an entire batch of tests. Before this
change, runlztest stopped after a single test failure. Now it runs
all tests, then reports a list of all tests that failed.

Also removed some sleeps so that skipped tests take approx no time,
instead of 2 seconds per skipped test.

Release Notes:

Details:


Tests:
When there are tests in the smokecheck which fail in lztest:
$ build-tools/runlztest.sh
Output should end with something like:
ERRORS in tests 0,test/lztest/lztest-lzdataelement.lzx,test/lztest/ 
lztest-view.lzx,test/lztest/lztest-textheight.lzx

When the smokecheck fails in lztest, the output of
    $ ant lztest
should end with something like this:
          [exec] error: In suite Test LzURL, test 0, failed  
assertion: FAIL: assertTrue('false') failed
          [exec] error: Failed 1 suites, Test LzURL
          [exec] FAILED a test in runlztest.sh: test/lztest/lztest- 
lzurl.lzx
          [exec] ERRORS in tests: 0,test/lztest/lztest-lzurl.lzx
          [exec] ERRORS in tests 0,test/lztest/lztest-lzurl.lzx

     BUILD FAILED
     /Users/ben/src/svn/openlaszlo/branches/legals-clean/build.xml: 
877: exec returned: 1


When the smokecheck passes in lztest, the output of
     $ ant lztest
should end with...
          [exec] no errors. done.

     BUILD SUCCESSFUL
     Total time: 2 minutes 26 seconds

Files:
M      build-tools/runlztest.sh

Changeset: http://svn.openlaszlo.org/openlaszlo/patches/20070702- 
ben-8.tar