Hello, I am facing this problem during the migration from ANT to Maven of ZooKeeper project.
We are happy to move to Maven but we noticed a bad problem on ASF CI: Sometime some test fails with the usual message "The forked VM terminated without properly saying goodbye" but Jenkins in not able to see the failure. I think this is because such error is not reported on XML report files. On the logs of the build I can see this line, so actually Surefire somehow detects the problem [ERROR] There are test failures. I know that it is documented that a test cannot call System.exit http://maven.apache.org/surefire/maven-surefire-plugin/faq.html#vm-termination I see that there are Jenkins plugin like: https://wiki.jenkins.io/display/JENKINS/Log+Parser+Plugin https://wiki.jenkins.io/display/JENKINS/Build+Failure+Analyzer Those plugins could be used to parse the logs and look for "There are test failures" but I can't find any of those plugin available in ZooKeeper builds, like: https://builds.apache.org/view/S-Z/view/ZooKeeper/job/zookeeper-master-maven/ But I wonder if anyone has ever found a solution, on Jenkins ASF, to this problem Enrico