On 13/03/2011 18:07, Ben Hutchings wrote:
Put two sets of benchmark results in two files (one number per line). ministat then calculates statistical measures of each set and a comparison of the two sets.
I've run the following in recovery mode (to avoid interference from other programs/daemons):
for i in $(seq 0 100); do \time find /usr >/dev/null; doneEvery results is composed by two line: i kept only the lines containing user and system time. Then discarded the first line to keep only data from cache. Then extrated only the columns containing system time. The two file (1 for 486, 1 for 686) were passed to ministat, which produced the attached file.
Ciao. Cesare.
x ministat-486.mod.txt
+ ministat-686.mod.txt
+------------------------------------------------------------------------+
| + |
| x + |
| x + |
| x + |
| x + |
| x + |
| x + |
| x + |
| x + |
| x x + |
| x x + |
| x x x + + |
| x x x x + + + |
| x x x x + + + |
| x x x x + + + |
| x * x x + + + |
| x * x x + + + |
| x * x * + + + |
| x * x * + + + |
| x * * * + + + |
| x x * * * * + + |
|x x x * * * * + + |
|x x * * * * * + + |
|x x * * * * * + + +|
|x x * * * * * * + +|
|x x * * * * * * * + +|
|* * * * * * * * * + +|
| |____________A__M_________| |
| |______________A_M____________| |
+------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 100 0.2 0.28 0.24 0.2349 0.018062462
+ 101 0.2 0.3 0.26 0.25752475 0.021043096
Difference at 95.0% confidence
0.0226248 +/- 0.00542407
9.63165% +/- 2.3091%
(Student's t, pooled s = 0.019617)