Rory: Dawid has given a bunch of great talks on our randomized testing setup over the years that are available online -- watch them all and you can even see how the aggressiveness of what we randomize has evolved...
2011: http://vimeo.com/32087114 2013: https://www.youtube.com/watch?v=zD57QKzqdCw 2014: https://www.youtube.com/watch?v=-uVE_w8flIU : Date: Fri, 02 Jan 2015 09:38:27 +0000 : From: Rory O'Donnell <[email protected]> : Reply-To: [email protected] : To: [email protected] : Cc: [email protected] : Subject: Re: Randomized testing talk (your favorite moment) : : Hi Dawid, : : I would love to hear more about randomized testing, where are you giving : the talk ? : : Rgds,Rory : On 02/01/2015 09:00, Dawid Weiss wrote: : > Hi everyone! : > : > I am giving a talk about randomized testing in a month or so and I : > thought it'd be cool to share some real-life "ah-crap", "gotcha", : > "wtf" moments related to the bugs discovered by randomized testing. : > : > My personal favorite is LUCENE-5168 (g1gc/ impossible code path) : > which, by the way, is still unresolved and we have no idea how to : > reproduce it reliably. Another is one of Robert's bugs with Unicode : > where he debugged what seemed like a "megabutt" of crazy-hairy random : > unicode that triggered the problem. These sorts of things. : > : > You can reply to the list or to my prv. e-mail if you wish. : > : > Dawid : > : > P.S. The talk's abstract is below here. : > : > Randomized Testing: When a Monkey Can do Better than Human. : > : > The talk will take a look at the concept of writing (unit) tests : > with predictable randomness. We will try to generalize: : > describe what such tests are, how to write them and how : > randomized testing can help in finding bugs in otherwise : > deterministic routines. We will also try to demonstrate on real-life : > examples that human understanding and predictions with : > regard to software are typically, ehm, incorrect (the same applies : > to mice and towels, see: THGTTG for full explanation). : > : > Randomized testing has been used extensively in Apache Lucene, : > Solr and ElasticSearch. Developers generally love it because it's effective : > at finding bugs and hate it when the bugs it finds are theirs to debug. : > : > --------------------------------------------------------------------- : > To unsubscribe, e-mail: [email protected] : > For additional commands, e-mail: [email protected] : > : : -- : Rgds,Rory O'Donnell : Quality Engineering Manager : Oracle EMEA , Dublin, Ireland : : : --------------------------------------------------------------------- : To unsubscribe, e-mail: [email protected] : For additional commands, e-mail: [email protected] : : -Hoss http://www.lucidworks.com/ --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
