[jira] [Created] (HDFS-8576) Lease recovery returns false , eventhough recovery happens.

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8576: Summary: Lease recovery returns false , eventhough recovery happens. Key: HDFS-8576 URL: https://issues.apache.org/jira/browse/HDFS-8576 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8577: Summary: Avoid retrying to recover lease on a file which does not exist Key: HDFS-8577 URL: https://issues.apache.org/jira/browse/HDFS-8577 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
Raju Bairishetti created HDFS-8578: -- Summary: On upgrade, Datanode should process all storage/data dirs in parallel Key: HDFS-8578 URL: https://issues.apache.org/jira/browse/HDFS-8578 Project: Hadoop

[jira] [Created] (HDFS-8579) Update HDFS usage with missing options

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8579: Summary: Update HDFS usage with missing options Key: HDFS-8579 URL: https://issues.apache.org/jira/browse/HDFS-8579 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

2015-06-11 Thread Walter Su (JIRA)
Walter Su created HDFS-8580: --- Summary: Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto Key: HDFS-8580 URL: https://issues.apache.org/jira/browse/HDFS-8580 Project: Hadoop HDFS

[jira] [Created] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-06-11 Thread tongshiquan (JIRA)
tongshiquan created HDFS-8581: - Summary: count cmd calculate wrong when huge files exist in one folder Key: HDFS-8581 URL: https://issues.apache.org/jira/browse/HDFS-8581 Project: Hadoop HDFS Is

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #214

2015-06-11 Thread Apache Jenkins Server
See Changes: [devaraj] MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. Contributed by [wang] HDFS-8549. Abort the balancer if an upgrade is in progress. [xgong] YARN-3785. Support for Resource as an argument during

Hadoop-Hdfs-trunk-Java8 - Build # 214 - Failure

2015-06-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/214/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7485 lines...] [INFO] --- maven-source-plugin:2.3:te

how to skip single corrupted SequenceFile in SequenceFileInputFormat ?

2015-06-11 Thread Zhang Xiaoyu
Hi, all, My MR job (consumer pipeline) is using SequenceFileInputFormat as as the input format in the MultipleInputs for (FileStatus input : inputs) { MultipleInputs.addInputPath(job, myPath, SequenceFileInputFormat.class, MyMapper.class); } My application will fail in condition that, when g

Re: how to skip single corrupted SequenceFile in SequenceFileInputFormat ?

2015-06-11 Thread Zhang Xiaoyu
sorry, just add on top of that, it will fail in two condition 1. the file flush something to it, with header and some data 2. the file flush nothing to it, so when vim the file, it is complete empty it will fail in both cases with the same exception, so looks like treat them both as corrupted fi

[jira] [Created] (HDFS-8582) Spurious failure messages when running datanode reconfiguration

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8582: --- Summary: Spurious failure messages when running datanode reconfiguration Key: HDFS-8582 URL: https://issues.apache.org/jira/browse/HDFS-8582 Project: Hadoop HDFS

[jira] [Created] (HDFS-8584) Support using ramfs partitions on Linux

2015-06-11 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8584: --- Summary: Support using ramfs partitions on Linux Key: HDFS-8584 URL: https://issues.apache.org/jira/browse/HDFS-8584 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-8585) Remove dataBlockNum and parityBlockNum from StripedBlockProto

2015-06-11 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8585: Summary: Remove dataBlockNum and parityBlockNum from StripedBlockProto Key: HDFS-8585 URL: https://issues.apache.org/jira/browse/HDFS-8585 Project: Hadoop HDFS Issue Type: