Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-02 Thread Zhijie Shen
+1 non-binding I built from source code, and setup a single node non-secure cluster with almost the default configurations and ran a number of MR example jobs and distributedshell jobs. I verified the generic and the per-framework (DS job only) historic information has been persisted, and such inf

[jira] [Resolved] (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-951. -- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free to

[jira] [Resolved] (HDFS-1336) TruncateBlock does not update in-memory information correctly

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1336. --- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free

[jira] [Resolved] (HDFS-108) File write fails after data node goes down

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-108. -- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free to

[jira] [Resolved] (HDFS-1106) Datanode throwing UnregisteredDatanodeException -- expects itself to serve storage!

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1106. --- Resolution: Not a Problem Resolving as Not a Problem. > Datanode throwing Unregistere

[jira] [Resolved] (HDFS-1290) decommissioned nodes report not consistent / clear

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1290. --- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free

[jira] [Resolved] (HDFS-148) timeout when writing dfs file causes infinite loop when closing the file

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-148. -- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free to

[jira] [Resolved] (HDFS-2420) improve handling of datanode timeouts

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2420. --- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free

[jira] [Resolved] (HDFS-2571) Error encountered while attempting a dfsadmin -report

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2571. --- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel free

[jira] [Resolved] (HDFS-1766) Datanode is marked dead, but datanode process is alive and verifying blocks

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1766. --- Resolution: Not a Problem Fix Version/s: (was: 0.24.0) I guess that this is

[jira] [Resolved] (HDFS-3333) java.io.IOException: File /user/root/lwr/test31.txt could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are

2014-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-. --- Resolution: Not a Problem I guess that this is not a problem anymore. Please feel fre

Re: Putting the hdfs client as a separate jar

2014-04-02 Thread Haohui Mai
The rpc and the web client can stay in one jar for the first cut. Indeed it might introduce some extra dependency, but the downstream projects always have the option to implement the webhdfs protocol themselves if they really need to avoid the dependency. Hadoop common is a bigger problem. Indeed

Re: Putting the hdfs client as a separate jar

2014-04-02 Thread Tsz Wo Sze
It is a very good idea although it might not be easy to do.  One aspect to consider is that do we need separated jars for rpc client and web client?  Now, suppose we could successfully separate HFDS Client jar(s) from HDFS.  However, HDFS Client uses Common as a library.  We have to separate Com

Putting the hdfs client as a separate jar

2014-04-02 Thread Haohui Mai
Hi, Many downstream projects needs the ability to access hdfs. In order to do this, currently downstream projects are forced to bring in the whole hdfs jar and its dependency, since both the hdfs server and the hdfs client reside in the same jar. To integrate with hdfs, the downstream projects ar

[jira] [Created] (HDFS-6188) A whitelist based implementation of TrustedChannelResolver

2014-04-02 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6188: -- Summary: A whitelist based implementation of TrustedChannelResolver Key: HDFS-6188 URL: https://issues.apache.org/jira/browse/HDFS-6188 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-6186) Pause deletion of blocks when the namenode starts up

2014-04-02 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-6186: - Summary: Pause deletion of blocks when the namenode starts up Key: HDFS-6186 URL: https://issues.apache.org/jira/browse/HDFS-6186 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2014-04-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6187: Summary: Update the document of hftp / hsftp in branch-2 Key: HDFS-6187 URL: https://issues.apache.org/jira/browse/HDFS-6187 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6185) HDFS operational and debuggability improvements

2014-04-02 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-6185: - Summary: HDFS operational and debuggability improvements Key: HDFS-6185 URL: https://issues.apache.org/jira/browse/HDFS-6185 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-6184) Better health check from ZKFC

2014-04-02 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6184: - Summary: Better health check from ZKFC Key: HDFS-6184 URL: https://issues.apache.org/jira/browse/HDFS-6184 Project: Hadoop HDFS Issue Type: Improvement Reporte