Re: Draft: compendium image validation testing matrix

2012-08-13 Thread Adam Williamson
On 2012-08-13 5:39, Kamil Paral wrote: https://fedoraproject.org/wiki/User:Adamwill/Draft_QA_Compendium_image_validation_results_template#Boot_and_sub-image_selection so 'multi_auto' would just be 'leave it, and check it does the right thing', 'multi_manual' would be a test case that's somethin

Re: Draft: compendium image validation testing matrix

2012-08-13 Thread Kamil Paral
> https://fedoraproject.org/wiki/User:Adamwill/Draft_QA_Compendium_image_validation_results_template#Boot_and_sub-image_selection > > so 'multi_auto' would just be 'leave it, and check it does the right > thing', 'multi_manual' would be a test case that's something like > 'try > every entry beside

Re: Draft: compendium image validation testing matrix

2012-08-10 Thread Adam Williamson
On Thu, 2012-08-09 at 05:49 -0400, Kamil Paral wrote: > > Hey, folks. So, as per https://fedorahosted.org/fedora-qa/ticket/307 > > , I > > think we need to add a process for validating the multi-live and > > multi-install images that we've been building for the last few > > releases. > > It is iro

Re: Draft: compendium image validation testing matrix

2012-08-10 Thread Adam Williamson
On Fri, 2012-08-10 at 03:23 -0400, Kamil Paral wrote: > > > How important is here to really burn it? Is ISO VM booting regarded > > > as > > > a reliable test or not? (Note: We don't burn classic Fedora images > > > when testing either.) > > > > I would want to, yes. I do burn classic images when

Re: Draft: compendium image validation testing matrix

2012-08-10 Thread Kamil Paral
> > How important is here to really burn it? Is ISO VM booting regarded > > as > > a reliable test or not? (Note: We don't burn classic Fedora images > > when testing either.) > > I would want to, yes. I do burn classic images when testing; the > tests > https://fedoraproject.org/wiki/QA:Testcase_

Re: Draft: compendium image validation testing matrix

2012-08-09 Thread Adam Williamson
On Thu, 2012-08-09 at 05:49 -0400, Kamil Paral wrote: > > QA:Testcase_multilive_boot and QA:Testcase_multidvd_boot - these will > > simply check that the compendium images themselves boot > > I don't understand what this means. > > To clarify, multidvd structure is this: > -> default DVD boot (a

Re: Draft: compendium image validation testing matrix

2012-08-09 Thread Kamil Paral
> Hey, folks. So, as per https://fedorahosted.org/fedora-qa/ticket/307 > , I > think we need to add a process for validating the multi-live and > multi-install images that we've been building for the last few > releases. It is ironic that before F17 release I have talked about this to cwickert (I

Draft: compendium image validation testing matrix

2012-08-08 Thread Adam Williamson
Hey, folks. So, as per https://fedorahosted.org/fedora-qa/ticket/307 , I think we need to add a process for validating the multi-live and multi-install images that we've been building for the last few releases. I've put together a draft matrix template for this validation here: https://fedoraproje