PaulAngus commented on issue #2209: CLOUDSTACK-10017: Adding 'quick-test' attribute to list of smoketests… URL: https://github.com/apache/cloudstack/pull/2209#issuecomment-429066327 in theory i agree @borisstoyanov - the problem there is how do you define fundamental. and given how large the component suite is (and how badly broken), results from component tests tend to get ignored. We could split the tests in to 3 categories - a set of true smoke tests basic vm lifecycle and network tests that take just a hour or two to run - a set of known good component tests - the remainder of smoke tests and known good component tests - broken tests - ones that rarely, if ever pass The broken tests can live in a separate directory, and as they get fixed, can be moved into the known good directory to be run in future. but by hook or by crook we need to get to a point where a failure *_really_* means a code issue. then we can be much more boolean about quality.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
