Build failed in Jenkins: Hadoop-Common-trunk #334

2012-03-02 Thread Apache Jenkins Server 
See 

Changes:

[atm] HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by 
Todd Lipcon.

[atm] HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart 
is racy. Contributed by Aaron T. Myers.

[szetszwo] HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated 
Syncable.sync().

[atm] HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. 
Contributed by Aaron T. Myers.

[szetszwo] HDFS-3021. Use generic type to declare FSDatasetInterface.

--
[...truncated 44626 lines...]
[DEBUG]   (f) reactorProjects = [MavenProject: 
org.apache.hadoop:hadoop-annotations:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-common:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ 

[DEBUG]   (f) useDefaultExcludes = true
[DEBUG]   (f) useDefaultManifestFile = false
[DEBUG] -- end configuration --
[INFO] 
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ 
hadoop-common-project ---
[DEBUG] Configuring mojo 
org.apache.maven.plugins:maven-enforcer-plugin:1.0:enforce from plugin realm 
ClassRealm[plugin>org.apache.maven.plugins:maven-enforcer-plugin:1.0, parent: 
sun.misc.Launcher$AppClassLoader@192d342]
[DEBUG] Configuring mojo 
'org.apache.maven.plugins:maven-enforcer-plugin:1.0:enforce' with basic 
configurator -->
[DEBUG]   (s) fail = true
[DEBUG]   (s) failFast = false
[DEBUG]   (f) ignoreCache = false
[DEBUG]   (s) project = MavenProject: 
org.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ 

[DEBUG]   (s) version = [3.0.2,)
[DEBUG]   (s) version = 1.6
[DEBUG]   (s) rules = 
[org.apache.maven.plugins.enforcer.RequireMavenVersion@2374a0, 
org.apache.maven.plugins.enforcer.RequireJavaVersion@1bdb786]
[DEBUG]   (s) session = org.apache.maven.execution.MavenSession@18f7701
[DEBUG]   (s) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersion
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cacheable.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -937312197 
was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: 
org.apache.maven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersion
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cacheable.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was 
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: 
org.apache.maven.plugins.enforcer.RequireJavaVersion
[INFO] 
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ 
hadoop-common-project ---
[DEBUG] Configuring mojo 
org.apache.maven.plugins:maven-site-plugin:3.0:attach-descriptor from plugin 
realm ClassRealm[plugin>org.apache.maven.plugins:maven-site-plugin:3.0, parent: 
sun.misc.Launcher$AppClassLoader@192d342]
[DEBUG] Configuring mojo 
'org.apache.maven.plugins:maven-site-plugin:3.0:attach-descriptor' with basic 
configurator -->
[DEBUG]   (f) basedir = 

[DEBUG]   (f) inputEncoding = UTF-8
[DEBUG]   (f) localRepository =id: local
  url: file:///home/jenkins/.m2/repository/
   layout: none

[DEBUG]   (f) outputEncoding = UTF-8
[DEBUG]   (f) pomPackagingOnly = true
[DEBUG]   (f) project = MavenProject: 
org.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ 

[DEBUG]   (f) reactorProjects = [MavenProject: 
org.apache.hadoop:hadoop-annotations:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ 

 MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT @

Build failed in Jenkins: Hadoop-Common-0.23-Build #180

2012-03-02 Thread Apache Jenkins Server 
See 

Changes:

[atm] HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by 
Todd Lipcon.

[szetszwo] svn merge -c 1295929 from trunk for HDFS-3021.

--
[...truncated 12384 lines...]
  [javadoc] Loading source files for package org.apache.hadoop.fs.shell...
  [javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
  [javadoc] Loading source files for package org.apache.hadoop.http...
  [javadoc] Loading source files for package org.apache.hadoop.http.lib...
  [javadoc] Loading source files for package org.apache.hadoop.io...
  [javadoc] Loading source files for package org.apache.hadoop.io.compress...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.bzip2...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.lz4...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.snappy...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.zlib...
  [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
  [javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
  [javadoc] Loading source files for package org.apache.hadoop.io.retry...
  [javadoc] Loading source files for package org.apache.hadoop.io.serializer...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.serializer.avro...
  [javadoc] Loading source files for package org.apache.hadoop.ipc...
  [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.jmx...
  [javadoc] Loading source files for package org.apache.hadoop.log...
  [javadoc] Loading source files for package org.apache.hadoop.log.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.file...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics.ganglia...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.util...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.annotation...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.filter...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.sink.ganglia...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.source...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
  [javadoc] Loading source files for package org.apache.hadoop.net...
  [javadoc] Loading source files for package org.apache.hadoop.record...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.ant...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.generated...
  [javadoc] Loading source files for package org.apache.hadoop.record.meta...
  [javadoc] Loading source files for package org.apache.hadoop.security...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.authorize...
  [javadoc] Loading source files for package org.apache.hadoop.security.token...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.token.delegation...
  [javadoc] Loading source files for package org.apache.hadoop.tools...
  [javadoc] Loading source files for package org.apache.hadoop.util...
  [javadoc] Loading source files for package org.apache.hadoop.util.bloom...
  [javadoc] Loading source files for package org.apache.hadoop.util.hash...
  [javadoc] 2 errors
 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- build-helper-maven-plugin:1.5:add-so

Build failed in Jenkins: Hadoop-Common-0.23-PB-Build #9

2012-03-02 Thread Apache Jenkins Server 
See 

--
[...truncated 12383 lines...]
  [javadoc] Loading source files for package org.apache.hadoop.io...
  [javadoc] Loading source files for package org.apache.hadoop.io.compress...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.bzip2...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.lz4...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.snappy...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.zlib...
  [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
  [javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
  [javadoc] Loading source files for package org.apache.hadoop.io.retry...
  [javadoc] Loading source files for package org.apache.hadoop.io.serializer...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.serializer.avro...
  [javadoc] Loading source files for package org.apache.hadoop.ipc...
  [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.jmx...
  [javadoc] Loading source files for package org.apache.hadoop.log...
  [javadoc] Loading source files for package org.apache.hadoop.log.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.file...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics.ganglia...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.util...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.annotation...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.filter...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.sink.ganglia...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.source...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
  [javadoc] Loading source files for package org.apache.hadoop.net...
  [javadoc] Loading source files for package org.apache.hadoop.record...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.ant...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.generated...
  [javadoc] Loading source files for package org.apache.hadoop.record.meta...
  [javadoc] Loading source files for package org.apache.hadoop.security...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.authorize...
  [javadoc] Loading source files for package org.apache.hadoop.security.token...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.token.delegation...
  [javadoc] Loading source files for package org.apache.hadoop.tools...
  [javadoc] Loading source files for package org.apache.hadoop.util...
  [javadoc] Loading source files for package org.apache.hadoop.util.bloom...
  [javadoc] Loading source files for package org.apache.hadoop.util.hash...
  [javadoc] 2 errors
 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ 
hadoop-common ---
[INFO] Source directory: 

 added.
[INFO] 
[INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) @ 
hadoop-common ---
[INFO] Test Source directory:

building error (maven-pdf-plugin:1.1:pdf ) !

2012-03-02 Thread mohammed elsaeedy 
Dear Mailing list,

   I've been trying to simply build the hadoop source code on my Macbook
Pro. I tried following the tutorial mentioned
here.
I grabbed the source code from github, and then I try  to run maven:

mvn install -DskipTests

mvn clean package -DskipTests -Pdist -Dtar -Dmaven.javadoc.skip=true


but I always get the following error:

*[INFO]
*
*[INFO] Total time: 14:48.283s*
*[INFO] Finished at: Fri Mar 02 13:29:20 EET 2012*
*[INFO] Final Memory: 68M/123M*
*[INFO]
*
*[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-pdf-plugin:1.1:pdf (pdf) on project
hadoop-distcp: Error during document generation: Error parsing
/Users/SaSa/Desktop/Hadoop/src/hadoop-common/hadoop-tools/hadoop-distcp/target/pdf/site.tmp/xdoc/index.xml:
Error validating the model: Fatal error:*
*[ERROR] Public ID: null*
*[ERROR] System ID: http://maven.apache.org/xsd/xdoc-2.0.xsd*
*[ERROR] Line number: 2699*
*[ERROR] Column number: 5*
*[ERROR] Message: The element type "xs:element" must be terminated by the
matching end-tag "".*
*[ERROR] -> [Help 1]*
*[ERROR] *
*[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.*
*[ERROR] Re-run Maven using the -X switch to enable full debug logging.*
*[ERROR] *
*[ERROR] For more information about the errors and possible solutions,
please read the following articles:*
*[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException*
*[ERROR] *
*[ERROR] After correcting the problems, you can resume the build with the
command*
*[ERROR]   mvn  -rf :hadoop-distcp*

I googled for a similar problem, all I got was some people cleared the m2
and ivy2 cahce, and rerun the command. But unfortunately didn't work for
me. I've been stuck here, I really hope anyone can help me with this issue.

Thank you all.
Regards,
SaSa



-- 
Mohammed El Sayed
Computer Science Department
King Abdullah University of Science and Technology
2351 - 4700 KAUST, Saudi Arabia
Home Page

[jira] [Created] (HADOOP-8133) upgrade {{commons-daemon.version}} in from 1.0.3 to 1.0.5 to avoid jsvc / libcap.so linking problem

2012-03-02 Thread Eugene Koontz (Created) (JIRA) 
upgrade {{commons-daemon.version}} in from 1.0.3 to 1.0.5 to avoid jsvc / 
libcap.so linking problem
---

 Key: HADOOP-8133
 URL: https://issues.apache.org/jira/browse/HADOOP-8133
 Project: Hadoop Common
  Issue Type: Bug
  Components: build, native
Affects Versions: 0.24.0
Reporter: Eugene Koontz


On several recent Linux distributions (tested Ubuntu 9.04, RHEL 6.2, Amazon 
Linux AMI release 2011.09), there is no libcap.so.1. With commons-daemon 1.0.3, 
the current version selected by {{hadoop-project/pom.xml}}, this causes a 
linking error:

{{
$ wget 
http://archive.apache.org/dist/commons/daemon/binaries/1.0.3/linux/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz
$ tar xfz commons-daemon-1.0.3-bin-linux-x86_64.tar.gz
$ ldd jsvc 
linux-vdso.so.1 =>  (0x743cc000)
libdl.so.2 => /lib64/libdl.so.2 (0x7f9cbbeee000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x7f9cbbcd2000)
libcap.so.1 => not found
libc.so.6 => /lib64/libc.so.6 (0x7f9cbb93)
/lib64/ld-linux-x86-64.so.2 (0x7f9cbc0fb000)
}}
The same problem also occurs with 1.0.4, but 1.0.5 doesn't have the problem:

{{
$ wget 
http://archive.apache.org/dist/commons/daemon/binaries/1.0.5/linux/commons-daemon-1.0.5-bin-linux-x86_64.tar.gz
$ tar xfz commons-daemon-1.0.5-bin-linux-x86_64.tar.gz 
$ ldd jsvc 
linux-vdso.so.1 =>  (0x7fff157ff000)
libdl.so.2 => /lib64/libdl.so.2 (0x7f9e14778000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x7f9e1455c000)
libcap.so.2 => /lib64/libcap.so.2 (0x7f9e14357000)
libc.so.6 => /lib64/libc.so.6 (0x7f9e13fb6000)
/lib64/ld-linux-x86-64.so.2 (0x7f9e14985000)
libattr.so.1 => /lib64/libattr.so.1 (0x7f9e13db2000)
}}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8134) DNS claims to return a hostname but returns a PTR record in some cases

2012-03-02 Thread Harsh J (Created) (JIRA) 
DNS claims to return a hostname but returns a PTR record in some cases
--

 Key: HADOOP-8134
 URL: https://issues.apache.org/jira/browse/HADOOP-8134
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Harsh J




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8135) Add ByteBufferReadable interface to FSDataInputStream

2012-03-02 Thread Henry Robinson (Created) (JIRA) 
Add ByteBufferReadable interface to FSDataInputStream
-

 Key: HADOOP-8135
 URL: https://issues.apache.org/jira/browse/HADOOP-8135
 Project: Hadoop Common
  Issue Type: New Feature
  Components: fs
Reporter: Henry Robinson
Assignee: Henry Robinson


To prepare for HDFS-2834, it's useful to add an interface to FSDataInputStream 
(and others inside hdfs) that adds a read(ByteBuffer...) method as follows:

{code}
  /**
   * Reads up to buf.remaining() bytes into buf. Callers should use
   * buf.limit(..) to control the size of the desired read.
   * 
   * After the call, buf.position() should be unchanged, and therefore any data
   * can be immediately read from buf.
   * 
   * @param buf
   * @return - the number of bytes available to read from buf
   * @throws IOException
   */
  public int read(ByteBuffer buf) throws IOException;
{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-7454) Common side of High Availability Framework (HDFS-1623)

2012-03-02 Thread Aaron T. Myers (Resolved) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron T. Myers resolved HADOOP-7454.


   Resolution: Fixed
Fix Version/s: 0.24.0
 Assignee: (was: Aaron T. Myers)
 Hadoop Flags: Reviewed

I just merged this to trunk.

> Common side of High Availability Framework (HDFS-1623)
> --
>
> Key: HADOOP-7454
> URL: https://issues.apache.org/jira/browse/HADOOP-7454
> Project: Hadoop Common
>  Issue Type: New Feature
>Reporter: Aaron T. Myers
> Fix For: 0.24.0
>
>
> There will likely need to be a few changes to Hadoop Common (e.g. HDFS-7380) 
> to complete HDFS-1623 (High Availability Framework for HDFS NN). This JIRA is 
> an umbrella for those Common changes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira