[jira] [Created] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10703: - Summary: HA NameNode Web UI should show last checkpoint time Key: HDFS-10703 URL: https://issues.apache.org/jira/browse/HDFS-10703 Project: Hadoop HDFS Issue Type:

datanode not respecting HADOOP_CONF_DIR on 3.0.0-alpha2(?)

2016-07-29 Thread Ewan Higgs
Hi all, I’m running trunk (204a2055b1b9270ae13ea03b7aeac62b65166efd) and when I run ‘hdfs datanode’ it doesn’t appear to respect the HADOOP_CONF_DIR in order to find the hdfs-site.xml and log4j.properties file. This is particularly strange since ‘hdfs namenode’ seems pretty content to pick up th

Re: Multiple namenodes

2016-07-29 Thread Ewan Higgs
Hi Daniel, “”” HDFS does not support two active NNs in a single cluster. Each DN belongs to a single NN, so a federated cluster is really multiple clusters that are stitched together at the NNs. “”” I don’t think this information is entirely correct as of 2.7. According to the doc

Re: datanode not respecting HADOOP_CONF_DIR on 3.0.0-alpha2(?)

2016-07-29 Thread Ewan Higgs
This has been solved. If HADOOP_CLASSPATH=$(hadoop classpath):/path/to/hadoop/tools/jar/dir then hdfs gets very confused and somehow decides it won’t respect the HADOOP_CONF_DIR. Solution: only add /path/to/hadoop/tools/jar/dir to HADOOP_CLASSPATH. This seems like an unpleasant sharp edge. You

[jira] [Created] (HDFS-10704) libhdfs++: FileSystem should not take ownership of IOService

2016-07-29 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10704: - Summary: libhdfs++: FileSystem should not take ownership of IOService Key: HDFS-10704 URL: https://issues.apache.org/jira/browse/HDFS-10704 Project: Hadoop HDFS I

[jira] [Created] (HDFS-10705) libhdfs++: FileSystem should have a convenience no-args ctor

2016-07-29 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10705: - Summary: libhdfs++: FileSystem should have a convenience no-args ctor Key: HDFS-10705 URL: https://issues.apache.org/jira/browse/HDFS-10705 Project: Hadoop HDFS I

[jira] [Resolved] (HDFS-10697) Erasure Code(6:3) can not work, using get fs shell when 2 datanode down

2016-07-29 Thread Alberic Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alberic Liu resolved HDFS-10697. Resolution: Not A Problem > Erasure Code(6:3) can not work, using get fs shell when 2 datanode down

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/117/ [Jul 28, 2016 7:58:23 AM] (aajisaka) HDFS-10696. TestHDFSCLI fails. Contributed by Kai Sasaki. [Jul 28, 2016 1:35:24 PM] (junping_du) YARN-5432. Lock already held by another process while LevelDB cache [Ju

Re: datanode not respecting HADOOP_CONF_DIR on 3.0.0-alpha2(?)

2016-07-29 Thread Allen Wittenauer
On 2016-07-29 03:05 (-0700), Ewan Higgs wrote: > If HADOOP_CLASSPATH=$(hadoop classpath):/path/to/hadoop/tools/jar/dir then > hdfs gets very confused and somehow decides it won’t respect the > HADOOP_CONF_DIR. > > Solution: only add /path/to/hadoop/tools/jar/dir to HADOOP_CLASSPATH. Short

[jira] [Created] (HDFS-10706) Add tool generating FSImage from external store

2016-07-29 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-10706: Summary: Add tool generating FSImage from external store Key: HDFS-10706 URL: https://issues.apache.org/jira/browse/HDFS-10706 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-10707) Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets

2016-07-29 Thread Vincent Poon (JIRA)
Vincent Poon created HDFS-10707: --- Summary: Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets Key: HDFS-10707 URL: https://issues.apache.org/jira/browse/HDFS-10707 Project: Ha