RE: [DISCUSS] Increasing the default block size

2012-10-15 Thread Uma Maheswara Rao G
+1 for increasing it to higher value by defaut (128/256MB) Most of the deployment which I worked are configured with 256MB and working well. From: Eli Collins [e...@cloudera.com] Sent: Tuesday, October 16, 2012 12:27 AM To: hdfs-dev@hadoop.apache.org Subje

[jira] [Created] (HDFS-4062) In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4062: --- Summary: In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock Key: HDFS-4062 URL: https://iss

[jira] [Created] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4061: - Summary: TestBalancer and TestUnderReplicatedBlocks need timeouts Key: HDFS-4061 URL: https://issues.apache.org/jira/browse/HDFS-4061 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-4060) TestHSync#testSequenceFileSync failed

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4060: - Summary: TestHSync#testSequenceFileSync failed Key: HDFS-4060 URL: https://issues.apache.org/jira/browse/HDFS-4060 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4059: --- Summary: Add number of stale DataNodes to metrics Key: HDFS-4059 URL: https://issues.apache.org/jira/browse/HDFS-4059 Project: Hadoop HDFS Issue Type: Sub-task Aff

[jira] [Created] (HDFS-4058) DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4058: - Summary: DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order Key: HDFS-4058 URL: https://issues.apache.org/jira/browse/HDFS-4058

[jira] [Created] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-15 Thread Brandon Li (JIRA)
Brandon Li created HDFS-4057: Summary: NameNode.namesystem should be private. Use getNamesystem() instead. Key: HDFS-4057 URL: https://issues.apache.org/jira/browse/HDFS-4057 Project: Hadoop HDFS

[jira] [Created] (HDFS-4056) Always start the NN's SecretManager

2012-10-15 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4056: - Summary: Always start the NN's SecretManager Key: HDFS-4056 URL: https://issues.apache.org/jira/browse/HDFS-4056 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-2257) HftpFileSystem should implement getDelegationTokens

2012-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-2257. --- Resolution: Won't Fix The {{getDelegationTokens}} api was removed. > HftpFileSystem s

[jira] [Created] (HDFS-4055) TestAuditLogs has some chances to fail.

2012-10-15 Thread Binglin Chang (JIRA)
Binglin Chang created HDFS-4055: --- Summary: TestAuditLogs has some chances to fail. Key: HDFS-4055 URL: https://issues.apache.org/jira/browse/HDFS-4055 Project: Hadoop HDFS Issue Type: Bug

Re: Status of CheckpointNode and BackupNode

2012-10-15 Thread Todd Lipcon
Agreed, it's been a maintenance burden, and no one using it or actively maintaining it (except for those of us working on other areas of the code who have to spend time maintaining it). -Todd On Mon, Oct 15, 2012 at 12:12 PM, Eli Collins wrote: > Hey gang, > > Is anyone using the BackupNode and

Min Long is out of the office.

2012-10-15 Thread Min Long
I will be out of the office starting 2012/10/15 and will not return until 2012/10/18. I will respond to mail on 10/18.

[jira] [Created] (HDFS-4054) Increase the invalidation rate based on the pending deletion count

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4054: - Summary: Increase the invalidation rate based on the pending deletion count Key: HDFS-4054 URL: https://issues.apache.org/jira/browse/HDFS-4054 Project: Hadoop HDFS

Status of CheckpointNode and BackupNode

2012-10-15 Thread Eli Collins
Hey gang, Is anyone using the BackupNode and/or CheckpointNode? I'm not aware of anyone using them, and the only outstanding related jira is HDFS-2064, which has been open for over a year and doesn't seem to be making progress. For the past three years the code has only been maintained as part

[DISCUSS] Increasing the default block size

2012-10-15 Thread Eli Collins
Heads up - I filed HDFS-4053 to increase the default HDFS block size in trunk for v3. It's been 64mb forever, and most production clusters I'm aware of use a higher value, it's worth considering changing the default. Thanks, Eli

[jira] [Created] (HDFS-4053) Increase the default block size

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4053: - Summary: Increase the default block size Key: HDFS-4053 URL: https://issues.apache.org/jira/browse/HDFS-4053 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4052) FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug information outside of the namesystem lock

2012-10-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4052: --- Summary: FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug information outside of the namesystem lock Key: HDFS-4052 URL:

[jira] [Created] (HDFS-4051) TestRBWBlockInvalidation.testBlockInvalidationWhenRBWReplicaMissedInDN failed

2012-10-15 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4051: - Summary: TestRBWBlockInvalidation.testBlockInvalidationWhenRBWReplicaMissedInDN failed Key: HDFS-4051 URL: https://issues.apache.org/jira/browse/HDFS-4051 Project: Hadoop H

[jira] [Created] (HDFS-4050) Reading from a specific block of a file

2012-10-15 Thread Jayanth Muthya (JIRA)
Jayanth Muthya created HDFS-4050: Summary: Reading from a specific block of a file Key: HDFS-4050 URL: https://issues.apache.org/jira/browse/HDFS-4050 Project: Hadoop HDFS Issue Type: New Fea