<br><br><div class="gmail_quote">On Thu, Dec 24, 2009 at 8:36 PM, Jason Dagit <span dir="ltr"><<a href="mailto:dagit@codersbase.com">dagit@codersbase.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div class="gmail_quote"><div><br></div><div>The next observation is that not all of the benchmarks work:</div><div>\begin{terminal dump}</div>
<div><div>$ darcs-benchmark darcs darcs-2.3.1</div><div>darcs get (full) [darcs]: 1!..2!.. 216.3s, 11.0M</div><div>darcs get (lazy, x10) [darcs]: 1!..2!.. 95.1s, 2.0M</div><div>
darcs pull 100 [darcs]: 1!..2... 5.1s, 17.0M</div>
<div>darcs annotate [darcs]: 1...2... 81.4s, 182.0M</div><div>darcs wh x50 [darcs]: 1...2... 2.9s, 2.0M</div><div>darcs wh mod x50 [darcs]: 1...2... 5.3s, 2.0M</div>
<div>darcs wh -l x20 [darcs]: 1...2... 1.8s, 2.0M</div><div>darcs check [darcs]: 1...2... 118.0s, 256.0M</div><div>darcs repair [darcs]: 1...2... 109.0s, 261.0M</div>
<div>darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error code 2</div><div>saying: </div><div>darcs failed: Can't unpull patch without reverting some unrecorded change.</div><div>)</div><div>darcs-2.3.1 get (full) [darcs]: 1...2!.. 250.2s, 10.0M</div>
<div>darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!.. 97.8s, 2.0M</div><div>darcs-2.3.1 pull 100 [darcs]: 1!..2... 7.6s, 23.0M</div><div>darcs-2.3.1 annotate [darcs]: 1...2... 88.0s, 180.0M</div>
<div>darcs-2.3.1 wh x50 [darcs]: 1...2... 3.2s, 2.0M</div><div>darcs-2.3.1 wh mod x50 [darcs]: 1...2... 5.1s, 2.0M</div><div>darcs-2.3.1 wh -l x20 [darcs]: 1...2... 5.0s, 4.0M</div>
<div>darcs-2.3.1 check [darcs]: 1...2... 25.9s, 50.0M</div><div>darcs-2.3.1 repair [darcs]: 1...2... 31.1s, 43.0M</div><div>darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with error code 2</div>
<div>saying: Reading pristine 26/485</div><div><br></div><div>darcs failed: Can't unpull patch without reverting some unrecorded change.</div><div>)</div><div>darcs get (full) [ghc-hashed]: 1!..</div></div><div>\end</div>
</div></blockquote><div><br></div><div>I've made it back to this point and I've been at this point for 1.5 hours wall time. I think if the benchmark takes this long it's a bit unrealistic. As an example, I suspect very few users would wait this long for darcs in practice. I did try to let it run overnight but I ran into a hitch in my automation and it failed (I suspect reindeer interference).</div>
<div><br></div><div>I'm interrupting it now and I'll try again tonight before I go to bed. Here are the numbers from my latest run:</div><div>\begin{terminal dump}</div><div><div> darcs-benchmark --get && darcs-benchmark darcs darcs-2.3.1</div>
<div>downloading and extracting: <a href="http://repos.mornfall.net/darcs/benchmark-repos/ghc-hashed.tgz">http://repos.mornfall.net/darcs/benchmark-repos/ghc-hashed.tgz</a></div><div>downloading and extracting: <a href="http://repos.mornfall.net/darcs/benchmark-repos/darcs.tgz">http://repos.mornfall.net/darcs/benchmark-repos/darcs.tgz</a></div>
<div>darcs get (full) [darcs]: 1!..2!.. 231.0s, 10.0M</div><div>darcs get (lazy, x10) [darcs]: 1!..2!.. 90.2s, 2.0M</div><div>darcs pull 100 [darcs]: 1!..2... 3.7s, 22.0M</div>
<div>darcs annotate [darcs]: 1...2... 12.1s, 182.0M</div><div>darcs wh x50 [darcs]: 1...2... 1.9s, 2.0M</div><div>darcs wh mod x50 [darcs]: 1...2... 3.7s, 2.0M</div>
<div>darcs wh -l x20 [darcs]: 1...2... 1.4s, 2.0M</div><div>darcs check [darcs]: 1...2... 39.6s, 260.0M</div><div>darcs repair [darcs]: 1...2... 39.2s, 249.0M</div>
<div>darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error code 2</div><div>saying: </div><div>darcs failed: Can't unpull patch without reverting some unrecorded change.</div><div>)</div><div>darcs-2.3.1 get (full) [darcs]: 1...2!.. 211.4s, 10.0M</div>
<div>darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!.. 92.4s, 2.0M</div><div>darcs-2.3.1 pull 100 [darcs]: 1!..2... 4.0s, 30.0M</div><div>darcs-2.3.1 annotate [darcs]: 1...2... 12.1s, 180.0M</div>
<div>darcs-2.3.1 wh x50 [darcs]: 1...2... 1.4s, 2.0M</div><div>darcs-2.3.1 wh mod x50 [darcs]: 1...2... 3.3s, 2.0M</div><div>darcs-2.3.1 wh -l x20 [darcs]: 1...2... 2.5s, 4.0M</div>
<div>darcs-2.3.1 check [darcs]: 1...2... 11.8s, 50.0M</div><div>darcs-2.3.1 repair [darcs]: 1...2... 11.1s, 50.0M</div><div>darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with error code 2</div>
<div>saying: Reading pristine 27/485</div><div><br></div><div>darcs failed: Can't unpull patch without reverting some unrecorded change.</div><div>)</div><div>darcs get (full) [ghc-hashed]: 1!..</div></div><div>\end</div>
<div><br></div><div>Jason</div></div>