[darcs-users] Darcs 2.4 - performance testing (stage 0)

Jason Dagit dagit at codersbase.com
Fri Dec 25 20:37:20 UTC 2009


On Thu, Dec 24, 2009 at 8:36 PM, Jason Dagit <dagit at codersbase.com> wrote:

>
> The next observation is that not all of the benchmarks work:
> \begin{terminal dump}
> $ darcs-benchmark darcs darcs-2.3.1
> darcs get (full) [darcs]: 1!..2!..                         216.3s, 11.0M
> darcs get (lazy, x10) [darcs]: 1!..2!..                    95.1s, 2.0M
> darcs pull 100 [darcs]: 1!..2...                           5.1s, 17.0M
> darcs annotate [darcs]: 1...2...                           81.4s, 182.0M
> darcs wh x50 [darcs]: 1...2...                             2.9s, 2.0M
> darcs wh mod x50 [darcs]: 1...2...                         5.3s, 2.0M
> darcs wh -l x20 [darcs]: 1...2...                          1.8s, 2.0M
> darcs check [darcs]: 1...2...                              118.0s, 256.0M
> darcs repair [darcs]: 1...2...                             109.0s, 261.0M
> darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error
> code 2
> saying:
> darcs failed:  Can't unpull patch without reverting some unrecorded change.
> )
> darcs-2.3.1 get (full) [darcs]: 1...2!..                   250.2s, 10.0M
> darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!..              97.8s, 2.0M
> darcs-2.3.1 pull 100 [darcs]: 1!..2...                     7.6s, 23.0M
> darcs-2.3.1 annotate [darcs]: 1...2...                     88.0s, 180.0M
> darcs-2.3.1 wh x50 [darcs]: 1...2...                       3.2s, 2.0M
> darcs-2.3.1 wh mod x50 [darcs]: 1...2...                   5.1s, 2.0M
> darcs-2.3.1 wh -l x20 [darcs]: 1...2...                    5.0s, 4.0M
> darcs-2.3.1 check [darcs]: 1...2...                        25.9s, 50.0M
> darcs-2.3.1 repair [darcs]: 1...2...                       31.1s, 43.0M
> darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with
> error code 2
> saying: Reading pristine 26/485
>
> darcs failed:  Can't unpull patch without reverting some unrecorded change.
> )
> darcs get (full) [ghc-hashed]: 1!..
> \end
>

I've made it back to this point and I've been at this point for 1.5 hours
wall time.  I think if the benchmark takes this long it's a bit unrealistic.
 As an example, I suspect very few users would wait this long for darcs in
practice.  I did try to let it run overnight but I ran into a hitch in my
automation and it failed (I suspect reindeer interference).

I'm interrupting it now and I'll try again tonight before I go to bed.  Here
are the numbers from my latest run:
\begin{terminal dump}
 darcs-benchmark --get && darcs-benchmark darcs darcs-2.3.1
downloading and extracting:
http://repos.mornfall.net/darcs/benchmark-repos/ghc-hashed.tgz
downloading and extracting:
http://repos.mornfall.net/darcs/benchmark-repos/darcs.tgz
darcs get (full) [darcs]: 1!..2!..                         231.0s, 10.0M
darcs get (lazy, x10) [darcs]: 1!..2!..                    90.2s, 2.0M
darcs pull 100 [darcs]: 1!..2...                           3.7s, 22.0M
darcs annotate [darcs]: 1...2...                           12.1s, 182.0M
darcs wh x50 [darcs]: 1...2...                             1.9s, 2.0M
darcs wh mod x50 [darcs]: 1...2...                         3.7s, 2.0M
darcs wh -l x20 [darcs]: 1...2...                          1.4s, 2.0M
darcs check [darcs]: 1...2...                              39.6s, 260.0M
darcs repair [darcs]: 1...2...                             39.2s, 249.0M
darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error
code 2
saying:
darcs failed:  Can't unpull patch without reverting some unrecorded change.
)
darcs-2.3.1 get (full) [darcs]: 1...2!..                   211.4s, 10.0M
darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!..              92.4s, 2.0M
darcs-2.3.1 pull 100 [darcs]: 1!..2...                     4.0s, 30.0M
darcs-2.3.1 annotate [darcs]: 1...2...                     12.1s, 180.0M
darcs-2.3.1 wh x50 [darcs]: 1...2...                       1.4s, 2.0M
darcs-2.3.1 wh mod x50 [darcs]: 1...2...                   3.3s, 2.0M
darcs-2.3.1 wh -l x20 [darcs]: 1...2...                    2.5s, 4.0M
darcs-2.3.1 check [darcs]: 1...2...                        11.8s, 50.0M
darcs-2.3.1 repair [darcs]: 1...2...                       11.1s, 50.0M
darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with
error code 2
saying: Reading pristine 27/485

darcs failed:  Can't unpull patch without reverting some unrecorded change.
)
darcs get (full) [ghc-hashed]: 1!..
\end

Jason
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osuosl.org/pipermail/darcs-users/attachments/20091225/a500a13c/attachment-0001.htm>


More information about the darcs-users mailing list