Hadoop-Hdfs-trunk-Java8 - Build # 1149 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1149/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6019 lines...] [INFO] --- maven-antrun-plugin:1.7:r

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1149

See Changes: [wang] HADOOP-13030. Handle special characters in passwords in KMS startup -- [...truncated 5826 lines...] Running org.apache.hadoop.hdfs.TestLease Tests run: 5, Failures: 0,

[jira] [Created] (HDFS-10340) data node sudden killed

tu nguyen khac created HDFS-10340: - Summary: data node sudden killed Key: HDFS-10340 URL: https://issues.apache.org/jira/browse/HDFS-10340 Project: Hadoop HDFS Issue Type: Bug Comp

[jira] [Created] (HDFS-10341) Add a metric to expose the timeout number of pending replication blocks

Akira AJISAKA created HDFS-10341: Summary: Add a metric to expose the timeout number of pending replication blocks Key: HDFS-10341 URL: https://issues.apache.org/jira/browse/HDFS-10341 Project: Hadoop

[jira] [Resolved] (HDFS-10340) data node sudden killed

[ https://issues.apache.org/jira/browse/HDFS-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-10340. --- Resolution: Invalid Please use the mailing list for future discussions of this nature. > data node su

Re: HDFS Federation

Kun, (1) The client-facing counter part of federation is ViewFileSystem, aka client side mount table.(2) Federation is supported in 2.7. There are test cases bringing up federated mini cluster, so I assume setting up a pseudo distributed cluster is possible. I am not sure whether all support sc

[jira] [Created] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

Daryn Sharp created HDFS-10342: -- Summary: BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt Key: HDFS-10342 URL: https://issues.apache.org/jira/browse/HDFS-10342 Proj

[jira] [Created] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

Daryn Sharp created HDFS-10343: -- Summary: BlockManager#createLocatedBlocks may return blocks on failed storages Key: HDFS-10343 URL: https://issues.apache.org/jira/browse/HDFS-10343 Project: Hadoop HDFS

Re: Recent PreCommit Jenkins failures

Thanks for taking a look at this Allen.. Will check out the patch.. -Arun On Apr 27, 2016 9:16 PM, "Allen Wittenauer" wrote: > > > On Apr 27, 2016, at 3:53 PM, Arun Suresh wrote: > > > > which I guess is due to the haskell site throwing a 502 and prior to > that I > > saw a couple of failures w

Re: HDFS Federation

Thanks a lot, Kihwal. So some code in the ViewFileSystem analysis the client request and transfer the request to the correct namenode, correct? Can you point out in particular which function do this? Thanks. On Thu, Apr 28, 2016 at 10:57 AM, Kihwal Lee wrote: > Kun, > > (1) The client-facing

[jira] [Created] (HDFS-10344) DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash

Xiaoyu Yao created HDFS-10344: - Summary: DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash Key: HDFS-10344 URL: https://issues.apache.org/jira/browse/HDFS-10344 Pro

Hadoop-Hdfs-trunk - Build # 3077 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3077/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5376 lines...] [INFO] --- maven-clean-plugin:2.5:clean (d

Build failed in Jenkins: Hadoop-Hdfs-trunk #3077

See Changes: [aw] HADOOP-13067. cleanup the dockerfile -- [...truncated 5183 lines...] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.219 sec - in org.apache.hadoop.hdfs.to

handlerCount

Hi Genius, I have a quick question: I remembered I saw the default value for HandlerCout is 10(The number of Handler threads), but I can not find where it is defined in the source code, could you please point to me where I can find it in the 2.7.2 codebase? Thanks a lot.

[jira] [Resolved] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9958. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Committed this to trunk through

Re: handlerCount

For name node, start from NameNodeRpcServer. From: Kun Ren To: hdfs-dev@hadoop.apache.org Sent: Thursday, April 28, 2016 4:51 PM Subject: handlerCount Hi Genius, I have a quick question: I remembered I saw the default value for HandlerCout is 10(The number of Handler threads), but

Re: handlerCount

Hello, In general, configuration property default values will be defined in two places: 1) hdfs-default.xml, which defines the default property values when a deployment doesn't specifically set them and 2) DFSConfigKeys, a class that defines constant default values that the code uses if for some r

Hadoop-Hdfs-trunk - Build # 3078 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3078/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5431 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #3078

See Changes: [kihwal] HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for -- [...truncated 5238 lines...] Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 4, Failures:

Re: handlerCount

Thanks a lot, Chris and Kihwal. I found it in the DFSConfigKeys as you mentioned. On Thu, Apr 28, 2016 at 6:00 PM, Chris Nauroth wrote: > Hello, > > In general, configuration property default values will be defined in two > places: 1) hdfs-default.xml, which defines the default property values

Another thought on client-side support of HDFS federation

Hey guys, My associates have investigated HDFS federation recently, which, turns out to be a quite good solution for improving scalability on NameNode/DataNode side. However, we encountered some problem on client-side. Since: A) For historical reason, we use clients in multiple languages to acces

Hadoop-Hdfs-trunk - Build # 3079 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3079/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6640 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #3079

See Changes: [jianhe] YARN-5008. LeveldbRMStateStore database can grow substantially leading -- [...truncated 6447 lines...] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sl

[jira] [Created] (HDFS-10345) Implement an asynchronous DistributedFileSystem

Xiaobing Zhou created HDFS-10345: Summary: Implement an asynchronous DistributedFileSystem Key: HDFS-10345 URL: https://issues.apache.org/jira/browse/HDFS-10345 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-10346) Implement asynchronous setPermission for DistributedFileSystem

Xiaobing Zhou created HDFS-10346: Summary: Implement asynchronous setPermission for DistributedFileSystem Key: HDFS-10346 URL: https://issues.apache.org/jira/browse/HDFS-10346 Project: Hadoop HDFS