[jira] [Resolved] (HDFS-5528) NPE in instantiating MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang resolved HDFS-5528. - Resolution: Duplicate > NPE in instantiating MiniDFSCluster > ---

Re: when datanode will delete these invalidate blocks?

Try looking in the heartbeat code on the NN and DN, it should clear things up. The namenode sends these block invalidations to the DN on the DN heartbeat response. The DN then deletes the blocks and on the next heartbeat reports to the NN that it invalidated the blocks. The NN then removes the inva

[jira] [Created] (HDFS-5528) NPE in instantiating MiniDFSCluster

Junping Du created HDFS-5528: Summary: NPE in instantiating MiniDFSCluster Key: HDFS-5528 URL: https://issues.apache.org/jira/browse/HDFS-5528 Project: Hadoop HDFS Issue Type: Bug Affects Ver

when datanode will delete these invalidate blocks?

hi,all: i read the replication monitor code ,in *invalidateWork *call it just add the invalidate block into the invalidateBlocks list of the DatanodeDescriptor class ,but i do not see any remove operation in replication monitor code ,my question is when these invalidate blocks will be r

[jira] [Created] (HDFS-5527) Fix TestUnderReplicatedBlocks

Junping Du created HDFS-5527: Summary: Fix TestUnderReplicatedBlocks Key: HDFS-5527 URL: https://issues.apache.org/jira/browse/HDFS-5527 Project: Hadoop HDFS Issue Type: Sub-task Affects Vers

[jira] [Created] (HDFS-5526) Datanode cannot roll back to previous layout version

Tsz Wo (Nicholas), SZE created HDFS-5526: Summary: Datanode cannot roll back to previous layout version Key: HDFS-5526 URL: https://issues.apache.org/jira/browse/HDFS-5526 Project: Hadoop HDFS

[jira] [Created] (HDFS-5525) Inline dust templates

Haohui Mai created HDFS-5525: Summary: Inline dust templates Key: HDFS-5525 URL: https://issues.apache.org/jira/browse/HDFS-5525 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Ha

[jira] [Resolved] (HDFS-5524) NPE during Namenode startup in Server#getNumConnections

[ https://issues.apache.org/jira/browse/HDFS-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5524. --- Resolution: Duplicate Good call, it's a dupe. Thanks Jing. > NPE during Namenode startup in Server#ge

[jira] [Created] (HDFS-5524) NPE during Namenode startup in Server#getNumConnections

Andrew Wang created HDFS-5524: - Summary: NPE during Namenode startup in Server#getNumConnections Key: HDFS-5524 URL: https://issues.apache.org/jira/browse/HDFS-5524 Project: Hadoop HDFS Issue Typ

Re: what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

thank you ! On Mon, Nov 18, 2013 at 11:48 PM, Kihwal Lee wrote: > Missing blocks are the blocks with no valid replicas. I.e. data is not > available. Corrupt blocks are the ones with at least one corrupt replica. > They may have healthy live replicas that are not corrupt, which can be read > by

Re: HDFS read/write data throttling

https://issues.apache.org/jira/browse/HDFS-5499 On Mon, Nov 18, 2013 at 10:46 AM, Jay Vyas wrote: > Where is the jira for this? > > Sent from my iPhone > > > On Nov 18, 2013, at 1:25 PM, Andrew Wang > wrote: > > > > Thanks for asking, here's a link: > > > > http://www.umbrant.com/papers/socc12

Re: HDFS read/write data throttling

Where is the jira for this? Sent from my iPhone > On Nov 18, 2013, at 1:25 PM, Andrew Wang wrote: > > Thanks for asking, here's a link: > > http://www.umbrant.com/papers/socc12-cake.pdf > > I don't think there's a recording of my talk unfortunately. > > I'll also copy my comments over to the

[jira] [Created] (HDFS-5523) Support subdirectory mount and multiple exports in HDFS-NFS gateway

Brandon Li created HDFS-5523: Summary: Support subdirectory mount and multiple exports in HDFS-NFS gateway Key: HDFS-5523 URL: https://issues.apache.org/jira/browse/HDFS-5523 Project: Hadoop HDFS

Re: HDFS read/write data throttling

Thanks for asking, here's a link: http://www.umbrant.com/papers/socc12-cake.pdf I don't think there's a recording of my talk unfortunately. I'll also copy my comments over to the JIRA, though I'd like to not distract too much from what Lohit's trying to do. On Wed, Nov 13, 2013 at 2:54 AM, Ste

Re: what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

Missing blocks are the blocks with no valid replicas. I.e. data is not available. Corrupt blocks are the ones with at least one corrupt replica. They may have healthy live replicas that are not corrupt, which can be read by users or replicated by the system to replace the corrupt replicas.  "Mis

Hadoop-Hdfs-0.23-Build - Build # 794 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/794/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7892 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #794

See -- [...truncated 7699 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

hi,all: CorruptBlocks is "Number of blocks with corrupt replicas" ,but the MissingBlocks is also from this.neededReplications.getCorruptBlockSize() ,any difference?

Re: block access token

Thanks Luke for your reply. The life time of block access token is ten hours, whether we should change two minutes? I think the shorter the life time of the token, token less likely to be stolen. 2013/11/14 Luke Lu > Block access token is only valid for a short period of time, as the NN/DN >