The "Test Result" pages for Jenkins builds shows some nice statistics for the test run, including individual test times:
https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/ Currently this only covers the Java / Scala tests, but we might be able to integrate the PySpark tests here, too (I think it's just a matter of getting the Python test runner to generate the correct test result XML output). On Fri, Jan 9, 2015 at 10:47 AM, Ted Yu <yuzhih...@gmail.com> wrote: > For a build which uses JUnit, we would see a summary such as the following > ( > https://builds.apache.org/job/HBase-TRUNK/6007/console): > > Tests run: 2199, Failures: 0, Errors: 0, Skipped: 25 > > > In > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/consoleFull > , I don't see such statistics. > > > Looks like scalatest-maven-plugin can be enhanced :-) > > > On Fri, Jan 9, 2015 at 3:52 AM, Sean Owen <so...@cloudera.com> wrote: > > > Hey Tony, the number of tests run could vary depending on how the > > build is configured. For example, YARN-related tests would only run > > when the yarn profile is turned on. Java 8 tests would only run under > > Java 8. > > > > Although I don't know that there's any reason to believe the IBM JVM > > has a problem with Spark, I see this issue that is potentially related > > to endian-ness : https://issues.apache.org/jira/browse/SPARK-2018 I > > don't know if that was a Spark issue. Certainly, would be good for you > > to investigate if you are interested in resolving it. > > > > The Jenkins output shows you exactly what tests were run and how -- > > have a look at the logs. > > > > > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/consoleFull > > > > On Fri, Jan 9, 2015 at 9:15 AM, Tony Reix <tony.r...@bull.net> wrote: > > > Hi Ted > > > > > > Thanks for the info. > > > However, I'm still unable to understand how the page: > > > > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/ > > > has been built. > > > This page contains details I do not find in the page you indicated to > me: > > > > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/consoleFull > > > > > > As an example, I'm still unable to find these details: > > > org.apache.spark< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark/ > > > > 12 mn 0 > > > 1 > > > 247 > > > 248 > > > > > > org.apache.spark.api.python< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark.api.python/ > > > > 20 ms 0 > > > 0 > > > 2 > > > 2 > > > > > > org.apache.spark.bagel< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark.bagel/ > > > > 7.7 s 0 > > > 0 > > > 4 > > > 4 > > > > > > org.apache.spark.broadcast< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark.broadcast/ > > > > 43 s 0 > > > 0 > > > 17 > > > 17 > > > > > > org.apache.spark.deploy< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark.deploy/ > > > > 16 s 0 > > > 0 > > > 29 > > > 29 > > > > > > org.apache.spark.deploy.worker< > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/org.apache.spark.deploy.worker/ > > > > 0.55 s 0 > > > 0 > > > 12 > > > 12 > > > > > > ........ > > > > > > > > > Moreover, in my Ubuntu/x86_64 environment, I do not find 3745 tests and > > 0 failures, but 3485 tests and 4 failures (when using Oracle JVM 1.7 ). > > When using IBM JVM, there are only 2566 tests and 5 failures (in same > > component: Streaming). > > > > > > On my PPC64BE (BE = Big-Endian)environment, the tests block after 2 > > hundreds of tests. > > > Is Spark independent of Little/Big-Endian stuff ? > > > > > > On my PPC64LE (LE = Little-Endian) environment, I have 3485 tests only > > (like on Ubuntu/x86_64 with IBM JVM), with 6 or 285 failures... > > > > > > So, I need to learn more about how your Jenkins environment extracts > > details about the results. > > > Moreover, which JVM is used ? > > > > > > Do you plan to use IBM JVM in order to check that Spark and IBM JVM are > > compatible ? (they already do not look to be compatible 100% ...). > > > > > > Thanks > > > > > > Tony > > > > > > IBM Coop Architect & Technical Leader > > > Office : +33 (0) 4 76 29 72 67 > > > 1 rue de Provence - 38432 Échirolles - France > > > www.atos.net<http://www.atos.net/> > > > ________________________________ > > > De : Ted Yu [yuzhih...@gmail.com] > > > Envoyé : jeudi 8 janvier 2015 17:43 > > > À : Tony Reix > > > Cc : dev@spark.apache.org > > > Objet : Re: Results of tests > > > > > > Here it is: > > > > > > [centos] $ > > > /home/jenkins/tools/hudson.tasks.Maven_MavenInstallation/Maven_3.0.5/bin/mvn > > -DHADOOP_PROFILE=hadoop-2.4 -Dlabel=centos -DskipTests -Phadoop-2.4 > -Pyarn > > -Phive clean package > > > > > > > > > You can find the above in > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/consoleFull > > > > > > > > > Cheers > > > > > > On Thu, Jan 8, 2015 at 8:05 AM, Tony Reix <tony.r...@bull.net<mailto: > > tony.r...@bull.net>> wrote: > > > Thanks ! > > > > > > I've been able to see that there are 3745 tests for version 1.2.0 with > > profile Hadoop 2.4 . > > > However, on my side, the maximum tests I've seen are 3485... About 300 > > tests are missing on my side. > > > Which Maven option has been used for producing the report file used for > > building the page: > > > > > > https://amplab.cs.berkeley.edu/jenkins/view/Spark/job/Spark-1.2-Maven-with-YARN/lastSuccessfulBuild/HADOOP_PROFILE=hadoop-2.4,label=centos/testReport/ > > > ? (I'm not authorized to look at the "configuration" part) > > > > > > Thx ! > > > > > > Tony > > > > > > ________________________________ > > > De : Ted Yu [yuzhih...@gmail.com<mailto:yuzhih...@gmail.com>] > > > Envoyé : jeudi 8 janvier 2015 16:11 > > > À : Tony Reix > > > Cc : dev@spark.apache.org<mailto:dev@spark.apache.org> > > > Objet : Re: Results of tests > > > > > > Please take a look at > https://amplab.cs.berkeley.edu/jenkins/view/Spark/ > > > > > > On Thu, Jan 8, 2015 at 5:40 AM, Tony Reix <tony.r...@bull.net<mailto: > > tony.r...@bull.net>> wrote: > > > Hi, > > > I'm checking that Spark works fine on a new environment (PPC64 > hardware). > > > I've found some issues, with versions 1.1.0, 1.1.1, and 1.2.0, even > when > > running on Ubuntu on x86_64 with Oracle JVM. I'd like to know where I can > > find the results of the tests of Spark, for each version and for the > > different versions, in order to have a reference to compare my results > > with. I cannot find them on Spark web-site. > > > Thx > > > Tony > > > > > > > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > > For additional commands, e-mail: dev-h...@spark.apache.org > > > > >
