[jira] [Created] (HDFS-8042) Erasure Coding: distribute replication to non-stripping erasure coding conversion work to DataNode

2015-04-02 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8042: --- Summary: Erasure Coding: distribute replication to non-stripping erasure coding conversion work to DataNode Key: HDFS-8042 URL: https://issues.apache.org/jira/browse/HDFS-8042

All the jenkins tests are failing

2015-04-02 Thread Steve Loughran
Can I draw attention to the fact that within the last week, every single Hadoop jenkins run has started failing. Ports in use https://issues.apache.org/jira/browse/YARN-3433 https://issues.apache.org/jira/browse/HADOOP-11788 NPEs https://issues.apache.org/jira/browse/HADOOP-11789 NPE in TestCry

Build failed in Jenkins: Hadoop-Hdfs-trunk #2083

2015-04-02 Thread Apache Jenkins Server
See Changes: [xgong] YARN-3248. Correct fix version from branch-2.7 to branch-2.8 in the change log. [wangda] YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wang

Hadoop-Hdfs-trunk - Build # 2083 - Still Failing

2015-04-02 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2083/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5986 lines...] [INFO] [INFO] --- maven-source-plugin:2.3

[jira] [Created] (HDFS-8043) NPE in MiniDFSCluster teardown

2015-04-02 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-8043: Summary: NPE in MiniDFSCluster teardown Key: HDFS-8043 URL: https://issues.apache.org/jira/browse/HDFS-8043 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Created] (HDFS-8044) NPE in TestCryptoStreamsWithOpensslAesCtrCryptoCodec

2015-04-02 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-8044: Summary: NPE in TestCryptoStreamsWithOpensslAesCtrCryptoCodec Key: HDFS-8044 URL: https://issues.apache.org/jira/browse/HDFS-8044 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8045: -- Summary: Incorrect calculation of NonDfsUsed and Remaining Key: HDFS-8045 URL: https://issues.apache.org/jira/browse/HDFS-8045 Project: Hadoop HDFS Issue Type: B

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #142

2015-04-02 Thread Apache Jenkins Server
See Changes: [xgong] YARN-3248. Correct fix version from branch-2.7 to branch-2.8 in the change log. [wangda] YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via

Hadoop-Hdfs-trunk-Java8 - Build # 142 - Still Failing

2015-04-02 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/142/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7075 lines...] [INFO] [INFO] --- maven-source-plugi

[jira] [Resolved] (HDFS-3449) TestFileCreation fails

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3449. --- Resolution: Duplicate Thanks. Resolving this as a duplicate of HDFS-3966. > TestFileC

[jira] [Resolved] (HDFS-7975) Warnings When Starting hadoop

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-7975. --- Resolution: Invalid This seems an issue in local environment but not a bug. Resolving

Re: [Federation setup] Adding a new name node to federated cluster

2015-04-02 Thread Kihwal Lee
You might be issuing the refresh command against the dataXfer port, not the rpc port of the datanode. -Kihwal From: Ajith shetty To: "hdfs-dev@hadoop.apache.org" Sent: Wednesday, April 1, 2015 1:43 AM Subject: [Federation setup] Adding a new name node to federated cluster Hi all,

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Allen Wittenauer
On Apr 2, 2015, at 9:51 AM, Karthik Kambatla wrote: >> >> a) remove CHANGES.TXT from trunk >> > > Removing this from trunk makes it particularly hard to cherry-pick changes > from trunk to branch-2. I would gate this on the removal of CHANGES.txt on > branch-2 as well, at least until we have s

[jira] [Created] (HDFS-8046) Allow better control of getContentSummary

2015-04-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-8046: Summary: Allow better control of getContentSummary Key: HDFS-8046 URL: https://issues.apache.org/jira/browse/HDFS-8046 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8047) Fix TestShellBasedIdMapping.testStaticMapUpdate failure on Windows

2015-04-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8047: Summary: Fix TestShellBasedIdMapping.testStaticMapUpdate failure on Windows Key: HDFS-8047 URL: https://issues.apache.org/jira/browse/HDFS-8047 Project: Hadoop HDFS

[jira] [Created] (HDFS-8048) Move HDFS client implmentation to a new package

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8048: - Summary: Move HDFS client implmentation to a new package Key: HDFS-8048 URL: https://issues.apache.org/jira/browse/HDFS-8048 Project: Hadoop HDFS I

[jira] [Created] (HDFS-8049) Annotation client implementation as private

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8049: - Summary: Annotation client implementation as private Key: HDFS-8049 URL: https://issues.apache.org/jira/browse/HDFS-8049 Project: Hadoop HDFS Issue

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Mai Haohui
Hi Allen, Thanks for driving this. Just some quick questions: >>Removing changes.txt, relnotes.py, etc from branch-2 would be an >> incompatible change. Pushing aside the questions of that document’s quality >> (hint: lots of outright lying and missing several hundred jiras), it's >>

[jira] [Created] (HDFS-8050) Separate the client conf key from DFSConfigKeys

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8050: - Summary: Separate the client conf key from DFSConfigKeys Key: HDFS-8050 URL: https://issues.apache.org/jira/browse/HDFS-8050 Project: Hadoop HDFS I

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Allen Wittenauer
On Apr 2, 2015, at 11:36 AM, Mai Haohui wrote: > Hi Allen, > > Thanks for driving this. Just some quick questions: > >>> Removing changes.txt, relnotes.py, etc from branch-2 would be an >>> incompatible change. Pushing aside the questions of that document’s >>> quality (hint: lots of

[jira] [Created] (HDFS-8051) FsVolumeList#addVolume should release volume reference if not put it into BlockScanner.

2015-04-02 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8051: --- Summary: FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. Key: HDFS-8051 URL: https://issues.apache.org/jira/browse/HDFS-8051 Pro

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Vinod Kumar Vavilapalli
We'd then doing two commits for every patch. Let's simply not remove CHANGES.txt from trunk, keep the existing dev workflow, but doc the release process to remove CHANGES.txt in trunk at the time of a release going out of trunk. +Vinod On Apr 2, 2015, at 10:12 AM, Allen Wittenauer mailto:a..

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Allen Wittenauer
On Apr 2, 2015, at 12:40 PM, Vinod Kumar Vavilapalli wrote: > > We'd then doing two commits for every patch. Let's simply not remove > CHANGES.txt from trunk, keep the existing dev workflow, but doc the release > process to remove CHANGES.txt in trunk at the time of a release going out of

Re: IMPORTANT: automatic changelog creation

2015-04-02 Thread Tsz Wo Sze
Generating change log from JIRA is a good idea.  It bases on an assumption that each JIRA has an accurate summary (a.k.a. JIRA title) to reflect the committed change. Unfortunately, the assumption is invalid for many cases since we never enforce that the JIRA summary must be the same as the chan

[jira] [Created] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8052: Summary: Move WebHdfsFileSystem into hadoop-hdfs-client Key: HDFS-8052 URL: https://issues.apache.org/jira/browse/HDFS-8052 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-8053) Move DFSOutputStream and related classes to hadoop-hdfs-client

2015-04-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8053: Summary: Move DFSOutputStream and related classes to hadoop-hdfs-client Key: HDFS-8053 URL: https://issues.apache.org/jira/browse/HDFS-8053 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-8054) Move DFSInputStream and related classes to hadoop-hdfs-client

2015-04-02 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8054: Summary: Move DFSInputStream and related classes to hadoop-hdfs-client Key: HDFS-8054 URL: https://issues.apache.org/jira/browse/HDFS-8054 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8055: -- Summary: NullPointerException when topology script is missing. Key: HDFS-8055 URL: https://issues.apache.org/jira/browse/HDFS-8055 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-8056) Decommissioned dead nodes should continue to be counted as dead after NN restart

2015-04-02 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8056: - Summary: Decommissioned dead nodes should continue to be counted as dead after NN restart Key: HDFS-8056 URL: https://issues.apache.org/jira/browse/HDFS-8056 Project: Hadoop HDFS

[jira] [Created] (HDFS-8057) Move BlockReader implementation to the client implementation package

2015-04-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8057: - Summary: Move BlockReader implementation to the client implementation package Key: HDFS-8057 URL: https://issues.apache.org/jira/browse/HDFS-8057 Project: H

RE: [Federation setup] Adding a new name node to federated cluster

2015-04-02 Thread Ajith shetty
Hi Yes you are right. refreshNamenodes seems to be working after using right rpc port. Thanks a ton Regards Ajith -Original Message- From: Kihwal Lee [mailto:kih...@yahoo-inc.com.INVALID] Sent: 03 April 2015 12:30 AM To: hdfs-dev@hadoop.apache.org Subject: Re: [Federation setup] Addin

[jira] [Resolved] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-04-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7839. - Resolution: Fixed Fix Version/s: HDFS-7285 > Erasure coding: implement facilities in NameNode to cre