Logged BUILDS-26 to track Colin's suggestion. FYI
On Mon, Oct 6, 2014 at 12:19 PM, Colin McCabe <cmcc...@alumni.cmu.edu> wrote: > On Thu, Oct 2, 2014 at 1:15 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > On my Mac and on Linux, I was able to > > find /usr/include/openssl/opensslconf.h > > > > However the file is absent on Jenkins machine(s). > > > > Just want to make sure that the file is needed for native build before > > filing INFRA ticket. > > opensslconf.h is part of the openssl-devel package (at least on my > machine) and if it is missing, I would suspect that openssl is either > not installed or incorrectly installed. > > We need it for the native build to have coverage for the > openssl-related things (like random number generation and encryption). > > Colin > > > > > Cheers > > > > On Thu, Oct 2, 2014 at 9:09 AM, Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com > > > > wrote: > > > >> Hi Ted, > >> > >> On my local, the build of trunk with "mvn package -Pnative,dist" works > >> well. I'm not certain whether this problem is related, but some build > >> fails on YARN(e.g. YARN-2562, YARN-2615, YARN-2640). > >> > >> The version information of OS and libssl-dev on my local environment > >> is as follows: > >> > >> $ uname -a > >> Linux ip-172-31-4-83 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 > >> 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux > >> > >> $ apt-cache show libssl-dev > >> Package: libssl-dev > >> Priority: optional > >> Section: libdevel > >> Installed-Size: 6162 > >> Maintainer: Ubuntu Developers <ubuntu-devel-disc...@lists.ubuntu.com> > >> Original-Maintainer: Debian OpenSSL Team > >> <pkg-openssl-de...@lists.alioth.debian.org> > >> Architecture: amd64 > >> Source: openssl > >> Version: 1.0.1f-1ubuntu2 > >> Depends: libssl1.0.0 (= 1.0.1f-1ubuntu2), zlib1g-dev > >> Recommends: libssl-doc > >> Filename: pool/main/o/openssl/libssl-dev_1.0.1f-1ubuntu2_amd64.deb > >> Size: 1066212 > >> MD5sum: 321724885048f9a78d0e93887a7eb296 > >> SHA1: e337538bed6e5765a0a85c4ca2af1d0deefd6ce0 > >> SHA256: ed199dc9131923fa3c911202f165402b1310f50dcdfab987f6f5c2669fc698cc > >> > >> Cheers, > >> - Tsuyoshi > >> > >> On Thu, Oct 2, 2014 at 11:43 PM, Ted Yu <yuzhih...@gmail.com> wrote: > >> > Hadoop-Common-trunk build failed due to missing opensslconf.h > >> > > >> > Is this environment issue or due to recent commits ? > >> > > >> > Cheers > >> > > >> > On Thu, Oct 2, 2014 at 7:31 AM, Apache Jenkins Server < > >> > jenk...@builds.apache.org> wrote: > >> > > >> >> See <https://builds.apache.org/job/Hadoop-Common-trunk/1257/> > >> >> > >> >> ------------------------------------------ > >> >> [exec] /usr/bin/cmake -E cmake_progress_report < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/CMakeFiles > >> > > >> >> 8 > >> >> [exec] [ 16%] Building C object > >> >> > >> > CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o > >> >> [exec] /usr/bin/cc -Dhadoop_EXPORTS -m32 -g -Wall -O2 > -D_REENTRANT > >> >> -D_GNU_SOURCE -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -fPIC -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/javah > >> > > >> >> -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src > >> > > >> >> -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src > >> > > >> >> -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/src > >> > > >> >> -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> > > >> >> -I/home/jenkins/tools/java/latest/include > >> >> -I/home/jenkins/tools/java/latest/include/linux -I< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/util > >> > > >> >> -o > >> >> > >> > CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o > >> >> -c < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c > >> >> > > >> >> [exec] In file included from < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/nat > >> >> > > >> >> [exec] > >> >> ive/src/org/apache/hadoop/crypto/org_apache_hadoop_crypto.h:33:0, > >> >> [exec] from < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c > >> >> >:19: > >> >> [exec] /usr/incl > >> >> [exec] ude/openssl/aes.h:55:33: fatal error: > openssl/opensslconf.h: > >> >> No such file or directory > >> >> [exec] #include <openssl/opensslconf.h> > >> >> [exec] ^ > >> >> [exec] compilation terminated. > >> >> [exec] make[2]: *** > >> >> > >> > [CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o] > >> >> Error 1 > >> >> [exec] make[1]: *** [CMakeFiles/hadoop.dir/all] Error 2 > >> >> [exec] make: *** [all] Error 2 > >> >> [exec] make[2]: Leaving directory `< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> >> '> > >> >> [exec] make[1]: Leaving directory `< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> >> '> > >> >> [INFO] > >> >> > ------------------------------------------------------------------------ > >> >> [INFO] Reactor Summary: > >> >> [INFO] > >> >> [INFO] Apache Hadoop Annotations ......................... SUCCESS [ > >> >> 6.890 s] > >> >> [INFO] Apache Hadoop MiniKDC ............................. SUCCESS [ > >> >> 11.827 s] > >> >> [INFO] Apache Hadoop Auth ................................ SUCCESS > >> [04:57 > >> >> min] > >> >> [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [ > >> >> 4.448 s] > >> >> [INFO] Apache Hadoop Common .............................. FAILURE [ > >> >> 21.471 s] > >> >> [INFO] Apache Hadoop NFS ................................. SKIPPED > >> >> [INFO] Apache Hadoop KMS ................................. SKIPPED > >> >> [INFO] Apache Hadoop Common Project ...................... SKIPPED > >> >> [INFO] > >> >> > ------------------------------------------------------------------------ > >> >> [INFO] BUILD FAILURE > >> >> [INFO] > >> >> > ------------------------------------------------------------------------ > >> >> [INFO] Total time: 05:43 min > >> >> [INFO] Finished at: 2014-10-02T14:30:49+00:00 > >> >> [INFO] Final Memory: 65M/763M > >> >> [INFO] > >> >> > ------------------------------------------------------------------------ > >> >> [ERROR] Failed to execute goal > >> >> org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on > project > >> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 > >> >> [ERROR] around Ant part ...<exec dir="< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> "> > >> >> executable="make" failonerror="true">... @ 7:160 in < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml > >> >> > > >> >> [ERROR] -> [Help 1] > >> >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to > >> execute > >> >> goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on > >> project > >> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 > >> >> around Ant part ...<exec dir="< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> "> > >> >> executable="make" failonerror="true">... @ 7:160 in < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml > >> >> > > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116) > >> >> at > >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361) > >> >> at > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) > >> >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) > >> >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213) > >> >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157) > >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > >> >> at > >> >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > >> >> at > >> >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > >> >> at java.lang.reflect.Method.invoke(Method.java:597) > >> >> at > >> >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) > >> >> at > >> >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) > >> >> at > >> >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) > >> >> at > >> >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) > >> >> Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant > >> >> BuildException has occured: exec returned: 2 > >> >> around Ant part ...<exec dir="< > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native > >> "> > >> >> executable="make" failonerror="true">... @ 7:160 in < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml > >> >> > > >> >> at > >> >> > org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:355) > >> >> at > >> >> > >> > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133) > >> >> at > >> >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) > >> >> ... 19 more > >> >> Caused by: < > >> >> > >> > https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml > >> >:7: > >> >> exec returned: 2 > >> >> at > >> >> org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:646) > >> >> at > >> >> org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:672) > >> >> at > >> >> org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:498) > >> >> at > >> >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > >> >> at sun.reflect.GeneratedMethodAccessor88.invoke(Unknown > Source) > >> >> at > >> >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > >> >> at java.lang.reflect.Method.invoke(Method.java:597) > >> >> at > >> >> > >> > org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > >> >> at org.apache.tools.ant.Task.perform(Task.java:348) > >> >> at org.apache.tools.ant.Target.execute(Target.java:390) > >> >> at org.apache.tools.ant.Target.performTasks(Target.java:411) > >> >> at > >> >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) > >> >> at > org.apache.tools.ant.Project.executeTarget(Project.java:1368) > >> >> at > >> >> > org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:327) > >> >> ... 21 more > >> >> [ERROR] > >> >> [ERROR] > >> >> [ERROR] For more information about the errors and possible solutions, > >> >> please read the following articles: > >> >> [ERROR] [Help 1] > >> >> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > >> >> [ERROR] > >> >> [ERROR] After correcting the problems, you can resume the build with > the > >> >> command > >> >> [ERROR] mvn <goals> -rf :hadoop-common > >> >> Build step 'Execute shell' marked build as failure > >> >> Archiving artifacts > >> >> Recording test results > >> >> > >> > >> > >> > >> -- > >> - Tsuyoshi > >> >
