[darcs-users] darcs-benchmark 0.1.9 - benchmarking help wanted for 2.5

[Eric Kow]

Hi everybody,

I'm pleased to announce the latest release of darcs-benchmark with some
nice backend work by Petr and a few UI tweaks from me.

With the Darcs-2.5 release getting closer and closer, we're going to
need a little more benchmarking help.

First: we're missing benchmarking numbers for Windows.  Max has
volunteered a few of them, but there are holes because darcs-benchmark
was buggy at the time.  Could I get a volunteer to flesh out our 2.5
benchmarks on Windows?  Perhaps Max?

Second: it'd be nice to have some numbers comparing old-fashioned
repositories on Darcs 1.0.9 with hashed repositories in Darcs 2.5.
Nathan, would you be interested in repeating your experiments?

Third: If you have already provided us with benchmarks for 2.4.4 vs 2.5,
could you please upgrade darcs-benchmark and re-run darcs-benchmark
report?

     cabal update
     cabal install darcs-benchmark
     darcs-benchmark report

There are some changes to how we report the results (mean => mean + sd,
and now graphs in front), and it would be great if all our benchmark
results were uniform.  Note also the darcs-benchmark run --converge
feature below if you're interested in refining your numbers (getting rid
of the "~" and "?"s)

Fourth: if you have participated in darcs benchmarking, but not for this
release, please move away the contents of your ~/.darcs-benchmark
directory to avoid cluttering the report.

Thanks all!

Eric

Changes in darcs-benchmark 0.1.9
--------------------------------
   * darcs binaries are now identified by a hash of darcs --exact-version
     to avoid lumping together results from different mid-release darcs
   * timings are now reported as mean + one standard deviation
   * graphs are displayed before numbers
   * new run --converge flag to runs benchmarks for which there is still
     insufficient data
   * support for hg/git variants of repositories (experimental, disabled
     by default)

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, please try +44 (0)1273 64 2905.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: Digital signature
URL: <http://lists.osuosl.org/pipermail/darcs-users/attachments/20100808/d4d23dfe/attachment.pgp>