Hi all,

I have some things to propose. We have some missing test cases and criteria. 
I'd like to know your opinion on this, so please, let me know if you have some 
notes.

I propose these changes in test cases:
* https://fedoraproject.org/wiki/QA:Testcase_Mediakit_ISO_Size is marked as 
alpha release level. I propose to change it to beta. We have beta criterion 
"The network installation image, DVD image, and live images for 
release-blocking desktops must meet current size requirements" for this. 
* https://fedoraproject.org/wiki/QA:Testcase_Kickstart_Http_Server_Ks_Cfg is 
associated with alpha release. I propose to change it to beta level, where is 
criterion: The installer must be able to use all kickstart delivery methods.

I propose these new criteria:
* Final criterion: "There must be published correct checksum for each ISO 
media. Also if there is embedded checksum on ISO media, it must be correct." - 
I think we should check this. We have already test case. I propose to change 
release level for this test case to final.
* Final criterion: "The installer must be able to run memory test." - again, we 
have test case for this yet. I'd move it to final level.
* Beta criterion: "The installer must be able to install system with minimal 
usable set of packages." - there is test case associated with alpha, I'd change 
it to beta release level
* Alpha criterion: "The installer must be able to download and apply 
updates.img file using a HTTP url and use it" - we have test cases for this, 
but no criterion. I think it's pretty importing -> alpha
* Beta criterion: "The installer must be able to use updates.img obtained by 
any supported way" - I think, that this should be at criteria too
* Final criterion: "The installer must be able to handle the failure and report 
the issue. The installer must be also able to access debug mode." - we have 
test case for this. It's useful to have this feature.

I propose to remove 
https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_efidisk.img test case 
as we don't need it anymore.

I propose to enhance alpha criterion "The installer must be able to report 
failures to Bugzilla, with appropriate information included" to "The installer 
must be able to report failures to Bugzilla, remote system and local disk, with 
appopriate information included" - especially saving failures to disk is 
important for installation without net access

And finaly, I propose these two test cases, both I'd like to have in final 
release level:
* 
https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Install_without_selinux
 - this test case is related to final criterion - "The installed system must 
run normally if the user chooses to install without SELinux" - I have one note 
on this. There is used noselinux option, but it doesn't work now. I filled bug 
https://bugzilla.redhat.com/show_bug.cgi?id=784828 there is another option with 
the same effect - selinux=0 and this one works fine, but Anaconda have 
noselinux in documentation, so it should work and they're working on it.
* https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Services_start 
- this one is related to final criterion "All services in a default install 
must start properly"

Regard
Petr Schindler
-- 
test mailing list
test@lists.fedoraproject.org
To unsubscribe:
https://admin.fedoraproject.org/mailman/listinfo/test

Reply via email to