Github user miguelaferreira commented on the pull request:
https://github.com/apache/cloudstack/pull/960#issuecomment-150169879
Does 100% pass rate when some of the tests have been skipped mean more than
100% pass rate when the same tests have been excluded?
I only hear about these BTV tests when a release is being prepared (I could
be wrong, and you maybe run these tests all the time). I'm actually building a
CI setup that will run every day all day, for all PRs. In such a setup I would
have made my live easier by just taking all the test available. But instead I
choose to careful select the test I'm running, to be sure about what I'm
testing. I already see that several tests need to be improved, and then more
tests added, and so on. This will lead to sustainable improvement.
Now, if you say that it is hard to maintain a list of tests to include in a
build, I would say that is the problem of the build and not the tests.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
