Hadoop-Hdfs-trunk - Build # 1041 - Still Failing

2012-05-12 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1041/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 11568 lines...]
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-hdfs-project 
---
[INFO] Executing tasks

main:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk/trunk/hadoop-hdfs-project/target/test-dir
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-dependency-plugin:2.1:build-classpath (build-classpath) @ 
hadoop-hdfs-project ---
[INFO] Wrote classpath file 
'/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk/trunk/hadoop-hdfs-project/target/classes/mrapp-generated-classpath'.
[INFO] 
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ 
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable 
package
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ 
hadoop-hdfs-project ---
[INFO] ** FindBugsMojo execute ***
[INFO] canGenerate is false
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop HDFS  SUCCESS [5:28.319s]
[INFO] Apache Hadoop HttpFS .. SUCCESS [37.543s]
[INFO] Apache Hadoop HDFS BookKeeper Journal . SUCCESS [13.004s]
[INFO] Apache Hadoop HDFS Fuse ... SUCCESS [0.063s]
[INFO] Apache Hadoop HDFS Project  SUCCESS [0.034s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 6:19.774s
[INFO] Finished at: Sat May 12 11:40:44 UTC 2012
[INFO] Final Memory: 84M/746M
[INFO] 
+ /home/jenkins/tools/maven/latest/bin/mvn test 
-Dmaven.test.failure.ignore=true -Pclover 
-DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
Updating HADOOP-8353
Updating HADOOP-8316
Updating HADOOP-8366
Updating HADOOP-8285
Updating HADOOP-8224
Updating HADOOP-8113
Updating MAPREDUCE-4148
Updating HADOOP-8395
Updating MAPREDUCE-4233
Updating HDFS-3211
Sending e-mails to: hdfs-dev@hadoop.apache.org
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
All tests passed

Build failed in Jenkins: Hadoop-Hdfs-trunk #1041

2012-05-12 Thread Apache Jenkins Server 
See 

Changes:

[harsh] HADOOP-8395. Text shell command unnecessarily demands that a 
SequenceFile's key class be WritableComparable (harsh)

[szetszwo] Move HDFS-3211 to 2.0.0 in CHANGES.txt.

[szetszwo] Move HADOOP-8285 and HADOOP-8366 to 2.0.0 in CHANGES.txt.

[szetszwo] Add HADOOP-8113 to CHANGES.txt

[bobby] MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby)

[eli] HADOOP-8224. Don't hardcode hdfs.audit.logger in the scripts. Contributed 
by Tomohiko Kinebuchi

[eli] HADOOP-8316. Audit logging should be disabled by default. Contributed by 
Eli Collins

[sradia] HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia)

[atm] HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on 
stop. Contributed by Roman Shaposhnik.

[tomwhite] MAPREDUCE-4148. MapReduce should not have a compile-time dependency 
on HDFS.

--
[...truncated 11375 lines...]
Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Generating 

Building index for all the packages and classes...
Generating

[jira] [Created] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.

2012-05-12 Thread Ashish Singhi (JIRA) 
Ashish Singhi created HDFS-3411:
---

 Summary: Balancer fails to balance blocks between aboveAvgUtilized 
and belowAvgUtilized datanodes.
 Key: HDFS-3411
 URL: https://issues.apache.org/jira/browse/HDFS-3411
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 0.23.0
Reporter: Ashish Singhi
 Fix For: 2.0.0, 3.0.0


Scaenario:
replication set to 1.
1. Start 1NN and IDN
2. pump 1GB of data.
3. Start one more DN
4. Run balancer with threshold 1.

Now DN1 is added into aboveAvgUtilizedDatanodes and DN2 into 
belowAvgUtilizedDatanodes. Hence overLoadedBytes and underLoadedBytes will be 
equal to 0. Resulting in bytesLeftToMove equal to 0. Thus balancer will exit 
without balancing the blocks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-3410) BlockPoolSliceScanner is too chatty

2012-05-12 Thread Eli Collins (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eli Collins resolved HDFS-3410.
---

Resolution: Duplicate

Yup, closing as a dupe. Thanks Uma.

> BlockPoolSliceScanner is too chatty
> ---
>
> Key: HDFS-3410
> URL: https://issues.apache.org/jira/browse/HDFS-3410
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Eli Collins
>  Labels: newbie
>
> The "Starting a new period" line gets logged on DNs every 5 seconds with the 
> default interval. Looks like this is because startNewPeriod is called by 
> scanBlockPoolSlice every 5 seconds and it does an invo level log.
> 2012-05-11 18:54:09,412 INFO 
> org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Periodic Block 
> Verification Scanner initialized with interval 504 hours for block pool 
> BP-132016845-172.29.122.91-1336787527316.
> ...
> 2012-05-11 18:54:14,216 INFO 
> org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Starting a new 
> period : work left in prev period : 0.00%

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-3412) Fix findbugs warnings in auto-HA branch

2012-05-12 Thread Todd Lipcon (JIRA) 
Todd Lipcon created HDFS-3412:
-

 Summary: Fix findbugs warnings in auto-HA branch
 Key: HDFS-3412
 URL: https://issues.apache.org/jira/browse/HDFS-3412
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: auto-failover, build
Affects Versions: Auto failover (HDFS-3042)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Minor


A few minor findbugs warnings snuck in. Nothing looks like a real bug, but we 
should fix before merging.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-3413) TestFailureToReadEdits timing out

2012-05-12 Thread Todd Lipcon (JIRA) 
Todd Lipcon created HDFS-3413:
-

 Summary: TestFailureToReadEdits timing out
 Key: HDFS-3413
 URL: https://issues.apache.org/jira/browse/HDFS-3413
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: ha, test
Affects Versions: 2.0.0, 3.0.0
Reporter: Todd Lipcon
Assignee: Colin Patrick McCabe
Priority: Critical


This test started timing out in build #1040: 
https://builds.apache.org/job/Hadoop-Hdfs-trunk/1040/
My guess is is of the following patches is at fault:

HADOOP-8361. Avoid out-of-memory problems when deserializing strings. 
Contributed by Colin Patrick McCabe (detail/ViewSVN)
HDFS-3134. harden edit log loader against malformed or malicious input. 
Contributed by Colin Patrick McCabe (detail/ViewSVN)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-3414) Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs

2012-05-12 Thread Aaron T. Myers (JIRA) 
Aaron T. Myers created HDFS-3414:


 Summary: Balancer does not find NameNode if rpc-address or 
servicerpc-address are not set in client configs
 Key: HDFS-3414
 URL: https://issues.apache.org/jira/browse/HDFS-3414
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 2.0.0
Reporter: Aaron T. Myers
Assignee: Aaron T. Myers
Priority: Minor


The balancer should also try to balance the NN if it's only specified via 
fs.defaultFS in the client config.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira