On 11/05/2013 01:49 PM, Chris Peterson wrote:
On 11/5/13, 7:10 AM, James Graham wrote:
Wht data do we currently have about why the wait time is so long? If
this data doesn't exist, can we start to collect it? Are there easy wins
to be had, or do we need to think about restructuring the way that we do
builds and/or testing to achieve greater throughput?
joduinn has detailed test time stats. I believe he posted them to
dev-tree-management..?
Some of our test suites run for 90 minutes, though the original goal
AFAIU was to limit test suites to 30 minutes. Splitting long test suites
could:
1. Increase test parallelization
2. Reduce retest time when rerunning orange tests!
3. Allow some ununnecessary test cases to be excised
cpeterson
Some of the B2G emulator suites can take ~10 minutes for setup/teardown,
so we purposefully let the chunks run a little longer to incur fewer
penalties there. Though no one has yet done the math to determine at
which point the benefits of chunking outweigh the cost of
setup/teardown. I would be very interested in knowing such a formula.
Andrew
_______________________________________________
dev-platform mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-platform
