Re: profiling hdfs write path

On 5 December 2012 02:00, Radim Kolar wrote: > > Agree. Want to write some? >> > Its not about writing patches, its about to get them committed. I have > experience that getting something committed takes months even on simple > patch. I have about 10 patches floating around none of them was com

[jira] [Created] (HDFS-4270) Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit

Derek Dagit created HDFS-4270: - Summary: Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit Key: HDFS-4270 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-4271) Problem in DFSInputStream read retry logic may cause early failure

Binglin Chang created HDFS-4271: --- Summary: Problem in DFSInputStream read retry logic may cause early failure Key: HDFS-4271 URL: https://issues.apache.org/jira/browse/HDFS-4271 Project: Hadoop HDFS

[jira] [Created] (HDFS-4272) Problem in DFSInputStream read retry logic may cause early failure

Binglin Chang created HDFS-4272: --- Summary: Problem in DFSInputStream read retry logic may cause early failure Key: HDFS-4272 URL: https://issues.apache.org/jira/browse/HDFS-4272 Project: Hadoop HDFS

[jira] [Created] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

Binglin Chang created HDFS-4273: --- Summary: Problem in DFSInputStream read retry logic may cause early failure Key: HDFS-4273 URL: https://issues.apache.org/jira/browse/HDFS-4273 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4272) Problem in DFSInputStream read retry logic may cause early failure

[ https://issues.apache.org/jira/browse/HDFS-4272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-4272. --- Resolution: Duplicate Seems like duplicate of HDFS-4271. > Problem in DFSInpu

[jira] [Created] (HDFS-4274) BlockPoolSliceScanner does not close verification log during shutdown

Chris Nauroth created HDFS-4274: --- Summary: BlockPoolSliceScanner does not close verification log during shutdown Key: HDFS-4274 URL: https://issues.apache.org/jira/browse/HDFS-4274 Project: Hadoop HDFS

[jira] [Created] (HDFS-4275) MiniDFSCluster-based tests fail on Windows due to failure to delete test name node directory

Chris Nauroth created HDFS-4275: --- Summary: MiniDFSCluster-based tests fail on Windows due to failure to delete test name node directory Key: HDFS-4275 URL: https://issues.apache.org/jira/browse/HDFS-4275

[jira] [Created] (HDFS-4276) HDFS tests have multiple failures on Windows due to file locking conflict

Chris Nauroth created HDFS-4276: --- Summary: HDFS tests have multiple failures on Windows due to file locking conflict Key: HDFS-4276 URL: https://issues.apache.org/jira/browse/HDFS-4276 Project: Hadoop H

[jira] [Resolved] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3049. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha Fixed the extra imports and committed to branch-2,

[jira] [Resolved] (HDFS-3571) Allow EditLogFileInputStream to read from a remote URL

[ https://issues.apache.org/jira/browse/HDFS-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3571. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha Committed backport to branch-2. Thanks for reviewi

[jira] [Resolved] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3077. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha Committed backport to branch-2. Thanks for looking

[jira] [Reopened] (HDFS-4110) Refine JNStorage log

[ https://issues.apache.org/jira/browse/HDFS-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-4110: --- Reopening to backport to branch-2 > Refine JNStorage log > > >

[jira] [Resolved] (HDFS-4110) Refine JNStorage log

[ https://issues.apache.org/jira/browse/HDFS-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-4110. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha Committed backport to branch-2 (same patch applied

[jira] [Created] (HDFS-4277) SocketTimeoutExceptions over the DataXciever service of a DN should print the DFSClient ID

Harsh J created HDFS-4277: - Summary: SocketTimeoutExceptions over the DataXciever service of a DN should print the DFSClient ID Key: HDFS-4277 URL: https://issues.apache.org/jira/browse/HDFS-4277 Project: Had

[jira] [Created] (HDFS-4278) The DFS_BLOCK_ACCESS_TOKEN_ENABLE config should be automatically turned on when security is enabled.

Harsh J created HDFS-4278: - Summary: The DFS_BLOCK_ACCESS_TOKEN_ENABLE config should be automatically turned on when security is enabled. Key: HDFS-4278 URL: https://issues.apache.org/jira/browse/HDFS-4278 Pr

Re: profiling hdfs write path

On Tue, Dec 4, 2012 at 6:00 PM, Radim Kolar wrote: > Its not about writing patches, its about to get them committed. I have > experience that getting something committed takes months even on simple > patch. I have about 10 patches floating around none of them was committed in > last 4 weeks. Coul

[jira] [Created] (HDFS-4279) NameNode does not initialize generic conf keys when started with -recover

Colin Patrick McCabe created HDFS-4279: -- Summary: NameNode does not initialize generic conf keys when started with -recover Key: HDFS-4279 URL: https://issues.apache.org/jira/browse/HDFS-4279 Pro

[jira] [Created] (HDFS-4280) InodeTree.java has redundant check for vName while throwing exception

Arup Malakar created HDFS-4280: -- Summary: InodeTree.java has redundant check for vName while throwing exception Key: HDFS-4280 URL: https://issues.apache.org/jira/browse/HDFS-4280 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4271) Problem in DFSInputStream read retry logic may cause early failure

[ https://issues.apache.org/jira/browse/HDFS-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang resolved HDFS-4271. - Resolution: Duplicate I didn't aware I have made 3 issues cause the bad internet connection

[jira] [Created] (HDFS-4281) NameNode recovery does not detect NN RPC address on HA cluster

Stephen Chu created HDFS-4281: - Summary: NameNode recovery does not detect NN RPC address on HA cluster Key: HDFS-4281 URL: https://issues.apache.org/jira/browse/HDFS-4281 Project: Hadoop HDFS I

Re: profiling hdfs write path

YARN-223 YARN-211 YARN-210 MAPREDUCE-4839 MAPREDUCE-4827

[jira] [Resolved] (HDFS-4281) NameNode recovery does not detect NN RPC address on HA cluster

[ https://issues.apache.org/jira/browse/HDFS-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu resolved HDFS-4281. --- Resolution: Duplicate Yes, I believe it is. Marking as duplicate. > NameNode recovery

[jira] [Created] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

Junping Du created HDFS-4282: Summary: TestEditLog.testFuzzSequences FAILED in all pre-commit test Key: HDFS-4282 URL: https://issues.apache.org/jira/browse/HDFS-4282 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4283) Spurious Test failures in TestEditLog.testFuzzSequences

Colin Patrick McCabe created HDFS-4283: -- Summary: Spurious Test failures in TestEditLog.testFuzzSequences Key: HDFS-4283 URL: https://issues.apache.org/jira/browse/HDFS-4283 Project: Hadoop HDFS