[darcs-users] darcs-benchmark 0.1.9 - benchmarking help wanted for 2.5

Nathan Gray kolibrie at graystudios.org
Tue Aug 17 13:52:25 UTC 2010


On Tue, Aug 17, 2010 at 10:37:34AM +0100, Eric Kow wrote:
> On Mon, Aug 16, 2010 at 11:16:00 -0400, Nathan Gray wrote:
> > I tried running some benchmarks over the weekend.  My computer
> > was unresponsive when I tried to login this morning.  I see that
> > one file was written at
> 
> Oh dear!
> 
> >   ~/.darcs-benchmarks/vs2-warm.timings/2010-08-13T2035
> 
> Perhaps tar-bzip2 your ~/.darcs-benchmark directory and send it
> our way.  It could provide some clues, although I'm a bit doubtful

Attached.

> > When I try to run any darcs-benchmark commands I now get:
> > 
> >   No benchmarks to run for <repo_name_here>
> 
> Which repository is this?

I tried several.  I think the problem is that I tried to do a
bunch of them all together over the weekend.  When that froze, or
died, or whatever it did when I was not watching, I am now not
able to run benchmarks on any of those repos.

They were all variants of my 'cap' repo that I have been using
for benchmarking darcs-1 versus darcs-2.

> That's funny. It should only do this when you either somehow tell
> darcs-benchmark not to run any benchmarks, or if you use the --converge
> flag.  Without any flags passed to darcs-benchmark, it should by rights
> run a standard set of benchmarks :-(
> 
> Any other hints? Command line options you may be using?

Just the command:

  $ darcs-benchmark run darcs-2.4.98.3 / cap-hashed
  No benchmarks to run for cap - hashed format

> > I ran my original benchmark over the weekend with darcs-2.4.98.2,
> > which means I would think that I would be able to run everything
> > again, since this is a new darcs binary.
> 
> For what it's worth, I don't think that the binaries are different
> enough to be worth repeating the benchmarking

I was not trying to repeat them.  I never got the results from
the weekend run because I had to reboot my computer.  Examining
the file it wrote in ~/.darcs-benchmarks, I do not think it
benchmarked more than one repo before running into problems.

> > I'm not sure how to get unstuck.
> 
> Could you try running darcs-benchmark on the tabular repo (it's a tiny
> repo which is mostly meant for checking darcs-benchark itself).

That seems to have worked.  Running on my cap repos still results
in the same error.

-kolibrie


  $ darcs-benchmark run darcs-2.4.98.3 / tabular
  ....

Benchmark Results
=====================================================

Machine description
    *Replace Me*
Year
    *Replace Me*
CPU 
    *Replace Me*
Memory
    *Replace Me*
Hard disk
    *Replace Me*
Notes
    *Replace Me*

How to read these tables
=====================================================

NB: times are reported as mean + 1 std deviation

* ?x = less than  5 runs used
* ~x = less than 20 runs used
* sdev = std deviation
* op = optimize --pristine variant

darcs-2.4.98.3: 2.4.98.3 (beta 3),
            2010-08-16 09:56:53, GHC 6.12.1


Timing Graphs
====================================================

tabular
-------

.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,13.929682&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+mod+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,27.001125&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+-l+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,18.06496&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=record+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,69.605644&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=revert+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,37.781113&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=(un)revert+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,97.24758&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(full)+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,84.472466&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(lazy)+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,49.274914&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+100+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,418.32626&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+1000+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,375.2449&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=check+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,86.58032&chbh=23,5,20  
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=repair+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,88.71645&chbh=23,5,20 
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=annotate+(ms)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,141.70232&chbh=23,5,20

Timings
====================================================

tabular
-------

==========  ===========  ========
            op 2.4.98.3      sdev
==========  ===========  ========
        wh       13.9ms   (1.1ms)
    wh mod       27.0ms   (3.2ms)
     wh -l       18.1ms   (1.3ms)
    record       69.6ms   (6.4ms)
    revert       37.8ms   (2.9ms)
(un)revert       97.2ms   (5.0ms)
get (full)       84.5ms   (4.8ms)
get (lazy)       49.3ms   (6.8ms)
  pull 100      418.3ms  (32.7ms)
 pull 1000      375.2ms   (9.1ms)
     check       86.6ms   (4.3ms)
    repair       88.7ms   (6.1ms)
  annotate      141.7ms   (5.0ms)
==========  ===========  ========


Memory Graphs
====================================================

tabular
-------

.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=wh+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=wh+mod+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:_&chtt=wh+-l+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,0.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=record+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=revert+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=(un)revert+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20 
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(full)+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20 
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=get+(lazy)+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20 
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+100+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,3.0&chbh=23,5,20   
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=pull+1000+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,3.0&chbh=23,5,20  
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=check+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,3.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=repair+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20
.. image:: http://chart.apis.google.com/chart?cht=bvg&chs=200x200&chd=s:9&chtt=annotate+(MiB)&chco=fce94f|c4a000|fcaf3e|ce5c00|e9b96e|8f5902&chxt=x,y&chxl=0:|op+2.4.98.3&chxr=1,0.0,2.0&chbh=23,5,20   

Memory
====================================================

tabular
-------

==========  ===========
            op 2.4.98.3
==========  ===========
        wh         0.0M
    wh mod         2.0M
     wh -l         0.0M
    record         2.0M
    revert         2.0M
(un)revert         2.0M
get (full)         2.0M
get (lazy)         2.0M
  pull 100         3.0M
 pull 1000         3.0M
     check         3.0M
    repair         2.0M
  annotate         2.0M
==========  ===========

-------------- next part --------------
A non-text attachment was scrubbed...
Name: darcs-benchmark.tar.bz2
Type: application/octet-stream
Size: 6451 bytes
Desc: not available
URL: <http://lists.osuosl.org/pipermail/darcs-users/attachments/20100817/3b052b5f/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: Digital signature
URL: <http://lists.osuosl.org/pipermail/darcs-users/attachments/20100817/3b052b5f/attachment.pgp>


More information about the darcs-users mailing list