[darcs-devel] [issue647] automated benchmarking and comparison

[Eric Kow]

New submission from Eric Kow <eric.kow at gmail.com>:

It would be really useful to have a quick and dirty benchmarking script that we
can either distribute with or alongside darcs

The script would just encode some current darcs benchmarking practices: namely,
getting a repository, obliterating a 1000 patches and pulling them back.  Having
it do the best of N trials is probably a good idea too.  Automatically
summarising the results (% improvement) would be nice too.

Perhaps a good way to do it is to have it be parameterisable with two
directories (with darcs built in both) and a repository.  To avoid people having
to choose a repository, we could also distribute the GHC one as the prototypical
large-ish repository and hopefully set our sights higher one day.

Also, I think it's more important for us to have a basic version of this script
now, than a fancy one later :-)

----------
messages: 3157
nosy: beschmi, droundy, kowey, tommy
priority: wishlist
status: unread
title: automated benchmarking and comparison

__________________________________
Darcs bug tracker <bugs at darcs.net>
<http://bugs.darcs.net/issue647>
__________________________________