Hadoop-Hdfs-trunk - Build # 535 - Still Failing

2010-12-28 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/535/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 679319 lines...]
[junit] 2010-12-28 12:48:05,996 WARN  datanode.FSDatasetAsyncDiskService 
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already 
shut down.
[junit] 2010-12-28 12:48:05,996 INFO  hdfs.MiniDFSCluster 
(MiniDFSCluster.java:shutdownDataNodes(786)) - Shutting down DataNode 0
[junit] 2010-12-28 12:48:06,108 INFO  ipc.Server (Server.java:stop(1611)) - 
Stopping server on 40529
[junit] 2010-12-28 12:48:06,108 INFO  ipc.Server (Server.java:run(1444)) - 
IPC Server handler 0 on 40529: exiting
[junit] 2010-12-28 12:48:06,109 INFO  ipc.Server (Server.java:run(675)) - 
Stopping IPC Server Responder
[junit] 2010-12-28 12:48:06,109 INFO  datanode.DataNode 
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads 
is 1
[junit] 2010-12-28 12:48:06,109 INFO  ipc.Server (Server.java:run(475)) - 
Stopping IPC Server listener on 40529
[junit] 2010-12-28 12:48:06,109 WARN  datanode.DataNode 
(DataXceiverServer.java:run(141)) - DatanodeRegistration(127.0.0.1:50922, 
storageID=DS-440938063-127.0.1.1-50922-1293540475177, infoPort=52032, 
ipcPort=40529):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at 
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at 
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:134)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit] 
[junit] 2010-12-28 12:48:06,111 INFO  datanode.DataNode 
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads 
is 0
[junit] 2010-12-28 12:48:06,212 INFO  datanode.DataBlockScanner 
(DataBlockScanner.java:run(622)) - Exiting DataBlockScanner thread.
[junit] 2010-12-28 12:48:06,212 INFO  datanode.DataNode 
(DataNode.java:run(1445)) - DatanodeRegistration(127.0.0.1:50922, 
storageID=DS-440938063-127.0.1.1-50922-1293540475177, infoPort=52032, 
ipcPort=40529):Finishing DataNode in: 
FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data2/current/finalized'}
[junit] 2010-12-28 12:48:06,212 INFO  ipc.Server (Server.java:stop(1611)) - 
Stopping server on 40529
[junit] 2010-12-28 12:48:06,213 INFO  datanode.DataNode 
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads 
is 0
[junit] 2010-12-28 12:48:06,213 INFO  datanode.FSDatasetAsyncDiskService 
(FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk 
service threads...
[junit] 2010-12-28 12:48:06,213 INFO  datanode.FSDatasetAsyncDiskService 
(FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads 
have been shut down.
[junit] 2010-12-28 12:48:06,214 WARN  datanode.FSDatasetAsyncDiskService 
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already 
shut down.
[junit] 2010-12-28 12:48:06,316 WARN  namenode.FSNamesystem 
(FSNamesystem.java:run(2822)) - ReplicationMonitor thread received 
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-28 12:48:06,316 INFO  namenode.FSEditLog 
(FSEditLog.java:printStatistics(631)) - Number of transactions: 6 Total time 
for transactions(ms): 2Number of transactions batched in Syncs: 0 Number of 
syncs: 3 SyncTimes(ms): 9 3 
[junit] 2010-12-28 12:48:06,316 WARN  namenode.DecommissionManager 
(DecommissionManager.java:run(70)) - Monitor interrupted: 
java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-28 12:48:06,318 INFO  ipc.Server (Server.java:stop(1611)) - 
Stopping server on 44595
[junit] 2010-12-28 12:48:06,318 INFO  ipc.Server (Server.java:run(1444)) - 
IPC Server handler 0 on 44595: exiting
[junit] 2010-12-28 12:48:06,319 INFO  ipc.Server (Server.java:run(675)) - 
Stopping IPC Server Responder
[junit] 2010-12-28 12:48:06,319 INFO  ipc.Server (Server.java:run(1444)) - 
IPC Server handler 7 on 44595: exiting
[junit] 2010-12-28 12:48:06,318 INFO  ipc.Server (Server.java:run(475)) - 
Stopping IPC Server listener on 44595
[junit] 2010-12-28 12:48:06,320 INFO  ipc.Server (Server.java:run(1444)) - 
IPC Server handler 2 on 44595: exiting
[junit] 2010-12-28 12:48:06,319 INFO  ipc.Server (Server.java:run(1444)) - 
IPC Server handler 3 on 44595: exiting
[junit] 2010-12-28 12:48:06,319 INFO  ipc.Server (Server.java:run(1444)) - 
IPC S

Review Request: Make Datanode handle errors to namenode.register call more elegantly

2010-12-28 Thread Dhruba Borthakur

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/195/
---

Review request for hadoop-hdfs.


Summary
---

Make Datanode handle errors to namenode.register call more elegantly


This addresses bug HDFS-1540.
https://issues.apache.org/jira/browse/HDFS-1540


Diffs
-

  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 1053403 

Diff: https://reviews.apache.org/r/195/diff


Testing
---

Running on our clusters for about one month now


Thanks,

Dhruba



Review Request: Make exiting safemode a lot faster.

2010-12-28 Thread Dhruba Borthakur

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/196/
---

Review request for hadoop-hdfs.


Summary
---

Make exiting safemode a lot faster.


This addresses bug HDFS-1391.
https://issues.apache.org/jira/browse/HDFS-1391


Diffs
-

  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/namenode/BlockManager.java
 1053405 
  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 1053405 
  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/test/hdfs/org/apache/hadoop/hdfs/server/namenode/TestOverReplicatedBlocks.java
 1053405 

Diff: https://reviews.apache.org/r/196/diff


Testing
---

Running on our biggest production cluster of 3000 nodes since Dec 13th


Thanks,

Dhruba



Re: Review Request: Make Datanode handle errors to namenode.register call more elegantly

2010-12-28 Thread Dhruba Borthakur

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/195/
---

(Updated 2010-12-28 13:55:18.599061)


Review request for hadoop-hdfs.


Changes
---

Incorporated Konstantin's review comments.


Summary
---

Make Datanode handle errors to namenode.register call more elegantly


This addresses bug HDFS-1540.
https://issues.apache.org/jira/browse/HDFS-1540


Diffs (updated)
-

  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 1053403 

Diff: https://reviews.apache.org/r/195/diff


Testing
---

Running on our clusters for about one month now


Thanks,

Dhruba



Re: Review Request: Make Datanode handle errors to namenode.register call more elegantly

2010-12-28 Thread Dhruba Borthakur

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/195/
---

(Updated 2010-12-28 14:09:46.364223)


Review request for hadoop-hdfs.


Summary
---

Make Datanode handle errors to namenode.register call more elegantly


This addresses bug HDFS-1540.
https://issues.apache.org/jira/browse/HDFS-1540


Diffs (updated)
-

  
http://svn.apache.org/repos/asf/hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 1053403 

Diff: https://reviews.apache.org/r/195/diff


Testing
---

Running on our clusters for about one month now


Thanks,

Dhruba