On Wed, Jan 23, 2013 at 11:34:37PM +0530, ASF IRC Services wrote: > # 8. ke4qqq # > 17:15:29 [chipc]: ke4qqq: anything for the group? > 17:15:42 [ke4qqq]: somewhat concerned about the API breakages and that > individuals are finding them rather than our testing > 17:16:12 [ke4qqq]: aside from that, nothing for the group > 17:16:34 [bhaisaab]: oh man, sorry guys, most of the stuff would be my > mistakes > 17:16:42 [bhaisaab]: but I'll make sure to fix them > 17:16:45 [chipc]: bhaisaab: mistakes happen! > 17:16:51 [chipc]: I think the question is around test coverage > 17:16:56 [ke4qqq]: bhaisaab: not concerned about it breaking itself > 17:16:57 [csears]: is there a specific example? > 17:17:03 [ke4qqq]: that will happen > 17:17:13 [ke4qqq]: more concerned that our testing (or lack thereof) isn't > catching it > 17:17:18 [chipc]: do you know where the test results from the automated > marvin tests are stored / published? > 17:17:33 [sudhap]: chipc: testing hasn't officially started yet - getting > there with automation setup being done > 17:18:02 [chipc]: csears: here's one example from today > http://markmail.org/thread/gbu4pkanncbe4xqt > 17:18:03 [ke4qqq]: sudhap: how can we declare something code complete without > any testing? > 17:18:10 [bhaisaab]: ke4qqq: Prasanna does seems to be here, we'll have more > coverage once we get those integration tests > 17:18:12 [topcloud]: sudhap: I don't think the problem is with qa testing. > 17:18:25 [sudhap]: ke4qqq: oh - I am talking about QA coverage not dev unit > testing
Sudha's team have managed to cannibalize packages from waf for some internal testing. I'll pick those up and setup the automated run that was running with 4.0 packages. I think we can get a decent coverage of the APIs with the marvin tests. I'll pick out the APIs being hit and post them out along with results. We can get some more coverage from those tests that will come in after ip clearance. Esp the network offering and vpc apis are hit in those. I've had in mind a rough plan for how automated testing can proceed alongside feature development in branches. But I confess I've had a little difficulty keeping up with the list of features. Will circulate the plan separately. Thanks, -- Prasanna.,
