[jira] [Created] (HDFS-2717) BookKeeper Journal output stream doesn't check addComplete rc

2011-12-22 Thread Ivan Kelly (Created) (JIRA) 
BookKeeper Journal output stream doesn't check addComplete rc
-

 Key: HDFS-2717
 URL: https://issues.apache.org/jira/browse/HDFS-2717
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Ivan Kelly
Assignee: Ivan Kelly


As summary says, we're not checking the addComplete return code, so there's a 
change of losing update. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Hadoop-Hdfs-0.23-Build - Build # 115 - Still Unstable

2011-12-22 Thread Apache Jenkins Server 
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/115/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 14071 lines...]
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-javadoc-plugin:2.7:jar (module-javadocs) @ hadoop-hdfs-project 
---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable 
package
[INFO] 
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
hadoop-hdfs-project ---
[INFO] Installing 
/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-0.23-Build/trunk/hadoop-hdfs-project/pom.xml
 to 
/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-hdfs-project/0.23.1-SNAPSHOT/hadoop-hdfs-project-0.23.1-SNAPSHOT.pom
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-hdfs-project 
---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-javadoc-plugin:2.7:jar (module-javadocs) @ hadoop-hdfs-project 
---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable 
package
[INFO] 
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ 
hadoop-hdfs-project ---
[INFO] 
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ 
hadoop-hdfs-project ---
[INFO] ** FindBugsMojo execute ***
[INFO] canGenerate is false
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop HDFS  SUCCESS [5:54.627s]
[INFO] Apache Hadoop HttpFS .. SUCCESS [42.600s]
[INFO] Apache Hadoop HDFS Project  SUCCESS [0.063s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 6:38.521s
[INFO] Finished at: Thu Dec 22 11:41:04 UTC 2011
[INFO] Final Memory: 70M/780M
[INFO] 
+ /home/jenkins/tools/maven/latest/bin/mvn test 
-Dmaven.test.failure.ignore=true -Pclover 
-DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Archiving artifacts
Publishing Clover coverage report...
Publishing Clover HTML report...
Publishing Clover XML report...
Publishing Clover coverage results...
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Publishing Javadoc
Recording fingerprints
Updating MAPREDUCE-3349
Updating HADOOP-7890
Updating MAPREDUCE-3586
Sending e-mails to: hdfs-dev@hadoop.apache.org
Email was triggered for: Unstable
Sending email for trigger: Unstable



###
## FAILED TESTS (if any) 
##
2 tests failed.
REGRESSION:  org.apache.hadoop.hdfs.TestDatanodeDeath.testComplex

Error Message:
unable to create new native thread

Stack Trace:
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:640)
at org.apache.hadoop.ipc.Server.start(Server.java:1703)
at 
org.apache.hadoop.hdfs.server.datanode.DataNode.runDatanodeDaemon(DataNode.java:1567)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:915)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:786)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:567)
at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:261)
at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:85)
at 
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:247)
at 
org.apache.hadoop.hdfs.TestDatanodeDeath.complexTest(TestDatanodeDeath.java:292)
at 
org.apache.hadoop.hdfs.TestDatanodeDeath.__CLR3_0_2fr8l6tz23(TestDatanodeDeath.java:418)
at 
org.apache.hadoop.hdfs.TestDatanodeDeath.testComplex(TestDatanodeDeath.java:418)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(Test

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #115

2011-12-22 Thread Apache Jenkins Server 
See

[jira] [Created] (HDFS-2718) Optimize OP_ADD in edits loading

2011-12-22 Thread Konstantin Shvachko (Created) (JIRA) 
Optimize OP_ADD in edits loading


 Key: HDFS-2718
 URL: https://issues.apache.org/jira/browse/HDFS-2718
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: name-node
Affects Versions: 0.22.0, 0.24.0, 1.0.0
Reporter: Konstantin Shvachko


During loading the edits journal FSEditLog.loadEditRecords() processes OP_ADD 
inefficiently. It first removes the existing INodeFile from the directory tree, 
then adds it back as a regular INodeFile, and then replaces it with 
INodeFileUnderConstruction if files is not closed. This slows down edits 
loading. OP_ADD should be done in one shot and retain previously existing data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-2719) HA: add checks in the namenode to ensure services are running in monitorHealth check

2011-12-22 Thread Suresh Srinivas (Created) (JIRA) 
HA: add checks in the namenode to ensure services are running in monitorHealth 
check


 Key: HDFS-2719
 URL: https://issues.apache.org/jira/browse/HDFS-2719
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
 Fix For: 0.24.0




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira