Re: profiling hdfs write path

I'm not saying that the Hadoop process is perfect, far from it, but from where I sit (like you I'm a contributor but not yet a committer) it seems to be working OK so far for both you and I. It does not work for me OK. Its way too slow. i got just 2k LOC in committed and still floating around p

[jira] [Created] (HDFS-4291) edit log unit tests leave stray test_edit_log_file around

Colin Patrick McCabe created HDFS-4291: -- Summary: edit log unit tests leave stray test_edit_log_file around Key: HDFS-4291 URL: https://issues.apache.org/jira/browse/HDFS-4291 Project: Hadoop HDFS

[jira] [Created] (HDFS-4290) Expose an event listener interface in DFSOutputStreams for block write pipeline status changes

Harsh J created HDFS-4290: - Summary: Expose an event listener interface in DFSOutputStreams for block write pipeline status changes Key: HDFS-4290 URL: https://issues.apache.org/jira/browse/HDFS-4290 Project:

[jira] [Created] (HDFS-4289) FsDatasetImpl#updateReplicaUnderRecovery throws errors validating replica byte count on Windows

Chris Nauroth created HDFS-4289: --- Summary: FsDatasetImpl#updateReplicaUnderRecovery throws errors validating replica byte count on Windows Key: HDFS-4289 URL: https://issues.apache.org/jira/browse/HDFS-4289

[jira] [Created] (HDFS-4288) NN accepts incremental BR as IBR in safemode

Daryn Sharp created HDFS-4288: - Summary: NN accepts incremental BR as IBR in safemode Key: HDFS-4288 URL: https://issues.apache.org/jira/browse/HDFS-4288 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4287) HTTPFS tests fail on Windows

Chris Nauroth created HDFS-4287: --- Summary: HTTPFS tests fail on Windows Key: HDFS-4287 URL: https://issues.apache.org/jira/browse/HDFS-4287 Project: Hadoop HDFS Issue Type: Bug Compon

Re: migration from hadoop cluster cdh3 to cdh4

Hi Shengjie, This question is specific to CDH and hence does not belong to the Apache HDFS development lists (Which is for HDFS project developers). I've hence moved your question to CDH's own user lists cdh-u...@cloudera.org ( https://groups.google.com/a/cloudera.org/forum/?fromgroups=#!forum/cdh

Build failed in Jenkins: Hadoop-Hdfs-trunk #1247

See Changes: [todd] HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. [acmurthy] MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHan

Hadoop-Hdfs-trunk - Build # 1247 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1247/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9917 lines...] Running org.apache.hadoop.fs.TestGlobPaths

Hadoop-Hdfs-0.23-Build - Build # 456 - Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/456/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12268 lines...] [INFO] Executed tasks [INFO] [INFO]

Jenkins build became unstable: Hadoop-Hdfs-0.23-Build #456

See