Hello folks, I remember that we had a quick chat about fuzzy testing in a QA meeting. IMHO we have much too many negative tests in tempest that aren't really complex. So I tried to build up a little tool that discovers the parameters of a client functions and randomizes the input for it.
It works like this: ./run_fuzzy_test.py image_client update_image -n 100 2013-10-19 13:42:10.634 27748 ERROR ClientFuzzTest [-] Bad request 2013-10-19 13:42:10.658 27748 ERROR ClientFuzzTest [-] Bad request 2013-10-19 13:42:10.670 27748 ERROR ClientFuzzTest [-] must be string or buffer, not int 2013-10-19 13:42:10.709 27748 ERROR ClientFuzzTest [-] Object not found 2013-10-19 13:42:10.738 27748 ERROR ClientFuzzTest [-] Bad request Could you give me some feedback about your thoughts: https://review.openstack.org/#/c/52768 It's maybe just a starting point for a discussion on the summit. Regards, Marc DEUTSCHE TELEKOM AG Digital Business Unit, Cloud Services (P&I) Marc Koderer Cloud Technology Software Developer T-Online-Allee 1, 64211 Darmstadt www.telekom.com LIFE IS FOR SHARING. DEUTSCHE TELEKOM AG Supervisory Board: Prof. Dr. Ulrich Lehner (Chairman) Board of Management: René Obermann (Chairman), Reinhard Clemens, Niek Jan van Damme, Timotheus Höttges, Dr. Thomas Kremer, Claudia Nemat, Prof. Dr. Marion Schick Commercial register: Amtsgericht Bonn HRB 6794 Registered office: Bonn BIG CHANGES START SMALL – CONSERVE RESOURCES BY NOT PRINTING EVERY E-MAIL. _______________________________________________ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev