[darcs-devel] [issue1899] Improve parser tests and quickchecks

[Jason Dagit]

New submission from Jason Dagit <aoeu>:

See patch318 for context.

Having some round trip quickchecks would be great.  From this effort to 
date (I had a few failed attempts at this refactor), I think these are some 
of the properties that ideal tests would check:

  1. Basic sanity checks, can things be parsed in the ideal/typical cases?
  2. How do high level parsers compose?  Since the parser monad is stateful 
on the input, it would be nice to check that the parsers do not consume 
more/less at the end of their parse than they were meant to.
  3. Sequences are dealt with correctly: empty sequences, many elements, 
good elements followed by partial elements, etc.
  4. linesStartingWith and linesStartingWithEndingWith are hard to get 
right and performance critical.
  5. Dealing with almost correct input.  Like fuzz testing.

In my experience, #2 is important but hard to define.  The purpose of #5 is 
to see if we accept things that should be rejected.  I'm not aware of 
anyone using fuzz testing with Haskell, but darcs would be a good candidate 
for that type of testing.  The more tests we have to cover #4, the more 
aggressively we can refactor those for performance reasons.

http://en.wikipedia.org/wiki/Fuzz_testing

----------
messages: 11863
nosy: dagit, dmitry.kurochkin
status: need-implementation
title: Improve parser tests and quickchecks

__________________________________
Darcs bug tracker <bugs at darcs.net>
<http://bugs.darcs.net/issue1899>
__________________________________