[Laszlo-checkins] r7708 - in tools/trunk/performance: cruncher src/org/openlaszlo/perf
ben@openlaszlo.org
ben at openlaszlo.org
Wed Jan 2 14:30:31 PST 2008
Author: ben
Date: 2008-01-02 14:30:27 -0800 (Wed, 02 Jan 2008)
New Revision: 7708
Modified:
tools/trunk/performance/cruncher/build.xml
tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
Log:
Change 20080102-ben-M by ben at slim.local on 2008-01-02 14:28:47 PST
in /Users/ben/src/svn/tools/trunk
for http://svn.openlaszlo.org/tools/trunk
Summary: Updates performance analysis tool to (ahem) work
Documentation:
To gather the data for performance analysis:
On each architecture of interest:
In $LPS_HOME/test/lfc/perf/build.xml edit these lines to indicate which browsers, branches, test suites, and runtimes you want to test:
var suites = ["sprite", "functions", "viewperf", "imageperformance", "textperformance"];
var runtimes = ["swf8", "dhtml"]; // swf7 numbers are boring, almost identical to swf8 numbers
var browsers = ["Firefox"];
var webapps = ["trunk"];
Then invoke ant to drive the tests... leave your machine alone for around 10 minutes while it runs the test.
$ cd $LPS_HOME/test/lfc/pref
$ ant -Dbranch=trunk hitallbrowsers storelog
This will result in a lot of log data being stored in svn -- the latest one (which I just stored) is here:
http://svn.openlaszlo.org/QA/performance/raw/7656-openlaszlo-trunk.txt
Each of those lines represents the results from one test (executed several times) in each suite. That's the raw data.
.....
The tool for analyzing the raw data is in $LZ_TOOLS_ROOT/performance/cruncher. It is a java program. To compile it, see instructions in
http://svn.openlaszlo.org/tools/trunk/performance/README.txt
cd $LZ_TOOLS_ROOT/performance/cruncher
ant -Dbuild.id=7656-openlaszlo-trunk go
performance/cruncher/build.xml fetches the raw performance logs for the specified build from subversion, runs the java performance analysis tool on it, and mails the results to a few interested parties. "ant go" is all you need.
The cruncher analyzes whatever data is in the checked-in raw log; it expects to analyze data recorded by test/lfc/perf/reporter.lzx via test/lfc/perf/reporter.jsp. The reporting itself does not need to happen on the same machine as the analysis.
Standard usage is from within the laszlosystems firewall (so we can send mail) and as a logged-in svn user with commit access to the repository. Then just
$ ant go
To run analysis on a particular build, pass in
-Dbuild.id=thebuildid for example
$ ant -Dbuild.id=2469-openlaszlo-branches-legals go
To prevent any interaction with subversion at all, pass in
-Dno.svn=true for example
$ ant -Dno.svn go
If you've already got the data locally and you just want to analyze it, with no network communication, do this
$ ant -v -Dno.svn=true -Dbuild.id=2469-openlaszlo-branches-legals analyze
$ more localanalysis/2469-openlaszlo-branches-legals-analysis.txt
Use the "clean" target to tidy up all local files. This is, of course, destructive.
Release Notes:
Details:
Tests:
Modified: tools/trunk/performance/cruncher/build.xml
===================================================================
--- tools/trunk/performance/cruncher/build.xml 2008-01-02 22:27:55 UTC (rev 7707)
+++ tools/trunk/performance/cruncher/build.xml 2008-01-02 22:30:27 UTC (rev 7708)
@@ -27,7 +27,7 @@
Use the "clean" target to tidy up all local files. This is, of course,
destructive.
- Copyright 2006 Laszlo Systems
+ Copyright 2006-2008 Laszlo Systems
</description>
<property name="build.mail.sender" value="ben at laszlosystems.com"/>
@@ -44,7 +44,7 @@
<exec executable="svn" output="repository-info.xml">
<arg value="info" />
<arg value="--xml" />
- <arg value="http://svn.openlaszlo.org/test/performance/raw" />
+ <arg value="http://svn.openlaszlo.org/QA/performance/raw" />
</exec>
<property name="done.get-svn-info" value="true" />
</sequential>
@@ -63,7 +63,7 @@
<mkdir dir="locallogs" />
<exec executable="svn" failonerror="true">
<arg value="export"/>
- <arg value="http://svn.openlaszlo.org/test/performance/raw/${build.id}.txt" />
+ <arg value="http://svn.openlaszlo.org/QA/performance/raw/${build.id}.txt" />
<arg value="locallogs/${build.id}.txt" />
</exec>
</target>
@@ -128,7 +128,7 @@
<arg value="import"/>
<arg value="-m 'automated import of performance analysis'" />
<arg value="localanalysis/${build.id}-analysis.txt" />
- <arg value="http://svn.openlaszlo.org/test/performance/analysis/${build.id}-analysis.txt" />
+ <arg value="http://svn.openlaszlo.org/QA/performance/analysis/${build.id}-analysis.txt" />
</exec>
</target>
Modified: tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java
===================================================================
--- tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java 2008-01-02 22:27:55 UTC (rev 7707)
+++ tools/trunk/performance/src/org/openlaszlo/perf/PerfResult.java 2008-01-02 22:30:27 UTC (rev 7708)
@@ -26,6 +26,7 @@
String buildDate = "unknown date";
String comment = "no comment";
String browserInfo = "no browser info";
+ String branch = "unspecified branch";
boolean debug = false;
static final boolean WARN_NULL_VALUES = false;
@@ -139,6 +140,8 @@
this.debug = Boolean.parseBoolean(val);
} else if (attr.equalsIgnoreCase("comment")) {
this.comment = val;
+ } else if (attr.equalsIgnoreCase("branch")) {
+ this.branch = val;
} else {
throw new Exception("Found unknown attribute in log: "
+ attr);
@@ -206,7 +209,7 @@
}
/* J_LZ_COPYRIGHT_BEGIN *******************************************************
-* Copyright 2006 Laszlo Systems, Inc. All Rights Reserved. *
+* Copyright 2006-2008 Laszlo Systems, Inc. All Rights Reserved. *
* Use is subject to license terms. *
* J_LZ_COPYRIGHT_END *********************************************************/
More information about the Laszlo-checkins
mailing list