On Thu, Oct 2, 2014 at 1:15 PM, Ted Yu <yuzhih...@gmail.com> wrote: > On my Mac and on Linux, I was able to > find /usr/include/openssl/opensslconf.h > > However the file is absent on Jenkins machine(s). > > Just want to make sure that the file is needed for native build before > filing INFRA ticket.
opensslconf.h is part of the openssl-devel package (at least on my machine) and if it is missing, I would suspect that openssl is either not installed or incorrectly installed. We need it for the native build to have coverage for the openssl-related things (like random number generation and encryption). Colin > > Cheers > > On Thu, Oct 2, 2014 at 9:09 AM, Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com> > wrote: > >> Hi Ted, >> >> On my local, the build of trunk with "mvn package -Pnative,dist" works >> well. I'm not certain whether this problem is related, but some build >> fails on YARN(e.g. YARN-2562, YARN-2615, YARN-2640). >> >> The version information of OS and libssl-dev on my local environment >> is as follows: >> >> $ uname -a >> Linux ip-172-31-4-83 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 >> 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux >> >> $ apt-cache show libssl-dev >> Package: libssl-dev >> Priority: optional >> Section: libdevel >> Installed-Size: 6162 >> Maintainer: Ubuntu Developers <ubuntu-devel-disc...@lists.ubuntu.com> >> Original-Maintainer: Debian OpenSSL Team >> <pkg-openssl-de...@lists.alioth.debian.org> >> Architecture: amd64 >> Source: openssl >> Version: 1.0.1f-1ubuntu2 >> Depends: libssl1.0.0 (= 1.0.1f-1ubuntu2), zlib1g-dev >> Recommends: libssl-doc >> Filename: pool/main/o/openssl/libssl-dev_1.0.1f-1ubuntu2_amd64.deb >> Size: 1066212 >> MD5sum: 321724885048f9a78d0e93887a7eb296 >> SHA1: e337538bed6e5765a0a85c4ca2af1d0deefd6ce0 >> SHA256: ed199dc9131923fa3c911202f165402b1310f50dcdfab987f6f5c2669fc698cc >> >> Cheers, >> - Tsuyoshi >> >> On Thu, Oct 2, 2014 at 11:43 PM, Ted Yu <yuzhih...@gmail.com> wrote: >> > Hadoop-Common-trunk build failed due to missing opensslconf.h >> > >> > Is this environment issue or due to recent commits ? >> > >> > Cheers >> > >> > On Thu, Oct 2, 2014 at 7:31 AM, Apache Jenkins Server < >> > jenk...@builds.apache.org> wrote: >> > >> >> See <https://builds.apache.org/job/Hadoop-Common-trunk/1257/> >> >> >> >> ------------------------------------------ >> >> [exec] /usr/bin/cmake -E cmake_progress_report < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/CMakeFiles >> > >> >> 8 >> >> [exec] [ 16%] Building C object >> >> >> CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o >> >> [exec] /usr/bin/cc -Dhadoop_EXPORTS -m32 -g -Wall -O2 -D_REENTRANT >> >> -D_GNU_SOURCE -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -fPIC -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/javah >> > >> >> -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src >> > >> >> -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src >> > >> >> -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/src >> > >> >> -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> > >> >> -I/home/jenkins/tools/java/latest/include >> >> -I/home/jenkins/tools/java/latest/include/linux -I< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/util >> > >> >> -o >> >> >> CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o >> >> -c < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c >> >> > >> >> [exec] In file included from < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/nat >> >> > >> >> [exec] >> >> ive/src/org/apache/hadoop/crypto/org_apache_hadoop_crypto.h:33:0, >> >> [exec] from < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c >> >> >:19: >> >> [exec] /usr/incl >> >> [exec] ude/openssl/aes.h:55:33: fatal error: openssl/opensslconf.h: >> >> No such file or directory >> >> [exec] #include <openssl/opensslconf.h> >> >> [exec] ^ >> >> [exec] compilation terminated. >> >> [exec] make[2]: *** >> >> >> [CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o] >> >> Error 1 >> >> [exec] make[1]: *** [CMakeFiles/hadoop.dir/all] Error 2 >> >> [exec] make: *** [all] Error 2 >> >> [exec] make[2]: Leaving directory `< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> >> '> >> >> [exec] make[1]: Leaving directory `< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> >> '> >> >> [INFO] >> >> ------------------------------------------------------------------------ >> >> [INFO] Reactor Summary: >> >> [INFO] >> >> [INFO] Apache Hadoop Annotations ......................... SUCCESS [ >> >> 6.890 s] >> >> [INFO] Apache Hadoop MiniKDC ............................. SUCCESS [ >> >> 11.827 s] >> >> [INFO] Apache Hadoop Auth ................................ SUCCESS >> [04:57 >> >> min] >> >> [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [ >> >> 4.448 s] >> >> [INFO] Apache Hadoop Common .............................. FAILURE [ >> >> 21.471 s] >> >> [INFO] Apache Hadoop NFS ................................. SKIPPED >> >> [INFO] Apache Hadoop KMS ................................. SKIPPED >> >> [INFO] Apache Hadoop Common Project ...................... SKIPPED >> >> [INFO] >> >> ------------------------------------------------------------------------ >> >> [INFO] BUILD FAILURE >> >> [INFO] >> >> ------------------------------------------------------------------------ >> >> [INFO] Total time: 05:43 min >> >> [INFO] Finished at: 2014-10-02T14:30:49+00:00 >> >> [INFO] Final Memory: 65M/763M >> >> [INFO] >> >> ------------------------------------------------------------------------ >> >> [ERROR] Failed to execute goal >> >> org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project >> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 >> >> [ERROR] around Ant part ...<exec dir="< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> "> >> >> executable="make" failonerror="true">... @ 7:160 in < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >> >> > >> >> [ERROR] -> [Help 1] >> >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >> execute >> >> goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on >> project >> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 >> >> around Ant part ...<exec dir="< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> "> >> >> executable="make" failonerror="true">... @ 7:160 in < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >> >> > >> >> at >> >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216) >> >> at >> >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> >> at >> >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> >> at >> >> >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108) >> >> at >> >> >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76) >> >> at >> >> >> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >> >> at >> >> >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116) >> >> at >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361) >> >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) >> >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) >> >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213) >> >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157) >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >> at >> >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> >> at >> >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> >> at java.lang.reflect.Method.invoke(Method.java:597) >> >> at >> >> >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >> >> at >> >> >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >> >> at >> >> >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >> >> at >> >> >> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >> >> Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant >> >> BuildException has occured: exec returned: 2 >> >> around Ant part ...<exec dir="< >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >> "> >> >> executable="make" failonerror="true">... @ 7:160 in < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >> >> > >> >> at >> >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:355) >> >> at >> >> >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133) >> >> at >> >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) >> >> ... 19 more >> >> Caused by: < >> >> >> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >> >:7: >> >> exec returned: 2 >> >> at >> >> org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:646) >> >> at >> >> org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:672) >> >> at >> >> org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:498) >> >> at >> >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) >> >> at sun.reflect.GeneratedMethodAccessor88.invoke(Unknown Source) >> >> at >> >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> >> at java.lang.reflect.Method.invoke(Method.java:597) >> >> at >> >> >> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) >> >> at org.apache.tools.ant.Task.perform(Task.java:348) >> >> at org.apache.tools.ant.Target.execute(Target.java:390) >> >> at org.apache.tools.ant.Target.performTasks(Target.java:411) >> >> at >> >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) >> >> at org.apache.tools.ant.Project.executeTarget(Project.java:1368) >> >> at >> >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:327) >> >> ... 21 more >> >> [ERROR] >> >> [ERROR] >> >> [ERROR] For more information about the errors and possible solutions, >> >> please read the following articles: >> >> [ERROR] [Help 1] >> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >> >> [ERROR] >> >> [ERROR] After correcting the problems, you can resume the build with the >> >> command >> >> [ERROR] mvn <goals> -rf :hadoop-common >> >> Build step 'Execute shell' marked build as failure >> >> Archiving artifacts >> >> Recording test results >> >> >> >> >> >> -- >> - Tsuyoshi >>
