Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1002

2016-03-15 Thread Apache Jenkins Server
See Changes: [wangda] MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic -- [...truncated 8856 lines...] [javadoc] [loading RegularFileObject[

Hadoop-Hdfs-trunk-Java8 - Build # 1002 - Failure

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1002/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9049 lines...] [INFO] --- maven-clean-plugin:2.5:cl

Hadoop-Hdfs-trunk - Build # 2933 - Failure

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2933/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8479 lines...] [INFO] --- maven-clean-plugin:2.5:clean (d

Build failed in Jenkins: Hadoop-Hdfs-trunk #2933

2016-03-15 Thread Apache Jenkins Server
See Changes: [wangda] MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic -- [...truncated 8286 lines...] [javadoc] [loading ZipFileIndexFileObject[

[jira] [Resolved] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10171. --- Resolution: Duplicate Fix Version/s: 2.8.0 {noformat} 2016-03-15 22:42:31,618 [Thread-0] INFO

[jira] [Created] (HDFS-10171) Balancer should log config values and iteration termination reasons

2016-03-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10171: - Summary: Balancer should log config values and iteration termination reasons Key: HDFS-10171 URL: https://issues.apache.org/jira/browse/HDFS-10171 Project: Hadoop HDFS

Jenkins build is back to normal : Hadoop-Hdfs-trunk #2932

2016-03-15 Thread Apache Jenkins Server
See

[jira] [Resolved] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8677. - Resolution: Fixed We'll revisit FsDataset changes later. > Ozone: Introduce KeyValueContainerDatas

[jira] [Resolved] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8661. - Resolution: Later We'll revisit FsDataset changes later. > DataNode should filter the set of NameS

[jira] [Resolved] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8679. - Resolution: Later We'll revisit FsDataset changes later. > Move DatasetSpi to new package > --

[jira] [Reopened] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8677: - > Ozone: Introduce KeyValueContainerDatasetSpi > > >

[jira] [Reopened] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8661: - > DataNode should filter the set of NameSpaceInfos passed to Datasets > ---

[jira] [Reopened] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8679: - > Move DatasetSpi to new package > -- > > Key: HDFS-8679 >

[jira] [Resolved] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8457. - Resolution: Later We'll revisit FsDataset changes later. > Ozone: Refactor FsDatasetSpi to pull up

[jira] [Reopened] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8457: - > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into > parent interface > --

[jira] [Resolved] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8392. - Resolution: Later We'll revisit FsDataset changes later. > DataNode support for multiple datasets

[jira] [Reopened] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8392: - > DataNode support for multiple datasets > -- > > K

[jira] [Reopened] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8210: - We've rebased the branch and this change was left out. Reopening the Jira. > Ozone: Implement storage

[jira] [Resolved] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10170. - Resolution: Fixed > DiskBalancer: Force rebase diskbalancer branch > -

[jira] [Created] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10170: --- Summary: DiskBalancer: Force rebase diskbalancer branch Key: HDFS-10170 URL: https://issues.apache.org/jira/browse/HDFS-10170 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-9955) DataNode won't self-heal after some block dirs were manually misplaced

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-9955. Resolution: Duplicate > DataNode won't self-heal after some block dirs were manually

Build failed in Jenkins: Hadoop-Hdfs-trunk #2931

2016-03-15 Thread Apache Jenkins Server
See Changes: [iwasakims] HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via -- [...truncated 5246 lines...] Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Fail

Hadoop-Hdfs-trunk - Build # 2931 - Still Failing

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2931/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5439 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Hadoop-Hdfs-trunk-Java8 - Build # 1000 - Still Failing

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1000/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7102 lines...] [INFO] --- maven-antrun-plugin:1.7:r

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1000

2016-03-15 Thread Apache Jenkins Server
See Changes: [iwasakims] HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via -- [...truncated 6909 lines...] Running org.apache.hadoop.cli.TestDeleteCLI Tests run: 1, Fail

[jira] [Resolved] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9904. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 > testCheckpointCancellationDur

[jira] [Created] (HDFS-10169) TestEditLog.testBatchedSyncWithClosedLogs sometimes fails.

2016-03-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-10169: - Summary: TestEditLog.testBatchedSyncWithClosedLogs sometimes fails. Key: HDFS-10169 URL: https://issues.apache.org/jira/browse/HDFS-10169 Project: Hadoop HDFS Issu

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #999

2016-03-15 Thread Apache Jenkins Server
See Changes: [sseth] YARN-4816. Fix incompatible change in SystemClock. -- [...truncated 5745 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.878 sec - in org

Hadoop-Hdfs-trunk-Java8 - Build # 999 - Still Failing

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/999/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5938 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

Hadoop-Hdfs-trunk - Build # 2930 - Still Failing

2016-03-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2930/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5322 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2930

2016-03-15 Thread Apache Jenkins Server
See Changes: [sseth] YARN-4816. Fix incompatible change in SystemClock. -- [...truncated 5129 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.438 sec - in org.apac

[jira] [Resolved] (HDFS-10028) CLONE - Detect if resevered EC Block ID is already used

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10028. --- Resolution: Invalid > CLONE - Detect if resevered EC Block ID is already used > --

[jira] [Resolved] (HDFS-10029) CLONE - DFSStripedOutputStream should not create empty blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10029. --- Resolution: Invalid > CLONE - DFSStripedOutputStream should not create empty blocks >

[jira] [Resolved] (HDFS-10027) CLONE - Add/implement necessary APIs even we just have the system default schema

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10027. --- Resolution: Invalid > CLONE - Add/implement necessary APIs even we just have the system default > sch

[jira] [Resolved] (HDFS-10032) CLONE - Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10032. --- Resolution: Invalid > CLONE - Failure handling: DFSStripedOutputStream continues writing with > enoug

[jira] [Resolved] (HDFS-10025) CLONE - Protobuf changes for BlockECRecoveryCommand and its fields for making it ready for transfer to DN

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10025. --- Resolution: Invalid > CLONE - Protobuf changes for BlockECRecoveryCommand and its fields for making >

[jira] [Resolved] (HDFS-10026) CLONE - Support DFS command for the EC encoding

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10026. --- Resolution: Invalid > CLONE - Support DFS command for the EC encoding > --

[jira] [Resolved] (HDFS-10030) CLONE - BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10030. --- Resolution: Invalid > CLONE - BlockManager.addBlockCollectionWithCheck should check if the block is >

[jira] [Resolved] (HDFS-10031) CLONE - Erasure Coding: Keep default schema's name consistent

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10031. --- Resolution: Invalid > CLONE - Erasure Coding: Keep default schema's name consistent >

[jira] [Resolved] (HDFS-10024) CLONE - Fix the editlog corruption exposed by failed TestAddStripedBlocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10024. --- Resolution: Invalid > CLONE - Fix the editlog corruption exposed by failed TestAddStripedBlocks >

[jira] [Resolved] (HDFS-10018) CLONE - Erasure Coding: Support specifying ECSchema during creation of ECZone

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10018. --- Resolution: Invalid > CLONE - Erasure Coding: Support specifying ECSchema during creation of ECZone >

[jira] [Resolved] (HDFS-10019) CLONE - Erasure Coding: Better to move EC related proto messages to a separate erasurecoding proto file

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10019. --- Resolution: Invalid > CLONE - Erasure Coding: Better to move EC related proto messages to a > separat

[jira] [Resolved] (HDFS-10020) CLONE - DFSStripedInputStream fails to read data after one stripe

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10020. --- Resolution: Invalid > CLONE - DFSStripedInputStream fails to read data after one stripe >

[jira] [Resolved] (HDFS-10017) CLONE - BlockManager treates good blocks in a block group as corrput

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10017. --- Resolution: Invalid > CLONE - BlockManager treates good blocks in a block group as corrput > -

[jira] [Resolved] (HDFS-10021) CLONE - Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10021. --- Resolution: Invalid > CLONE - Erasure Coding: Maintain consistent naming for Erasure Coding related >

[jira] [Resolved] (HDFS-10022) CLONE - Client gets and uses EC schema when reads and writes a stripping file

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10022. --- Resolution: Invalid > CLONE - Client gets and uses EC schema when reads and writes a stripping file >

[jira] [Resolved] (HDFS-10023) CLONE - Send the EC schema to DataNode via EC encoding/recovering command

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10023. --- Resolution: Invalid > CLONE - Send the EC schema to DataNode via EC encoding/recovering command >

[jira] [Resolved] (HDFS-10015) CLONE - Erasure coding: Add auditlog FSNamesystem#createErasureCodingZone if this operation fails

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10015. --- Resolution: Invalid > CLONE - Erasure coding: Add auditlog FSNamesystem#createErasureCodingZone if >

[jira] [Resolved] (HDFS-10014) CLONE - Make hard-coded values consistent with the system default schema first before remove them

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10014. --- Resolution: Invalid > CLONE - Make hard-coded values consistent with the system default schema > firs

[jira] [Resolved] (HDFS-10016) CLONE - Erasure coding: created util class to analyze striped block groups

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10016. --- Resolution: Invalid > CLONE - Erasure coding: created util class to analyze striped block groups > ---

[jira] [Resolved] (HDFS-10009) CLONE - Erasure coding: Decommission handle for EC blocks.

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10009. --- Resolution: Invalid > CLONE - Erasure coding: Decommission handle for EC blocks. > ---

[jira] [Resolved] (HDFS-10007) CLONE - Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10007. --- Resolution: Invalid > CLONE - Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits > -

[jira] [Resolved] (HDFS-10012) CLONE - Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode.

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10012. --- Resolution: Invalid > CLONE - Erasure Coding: Add RPC to client-namenode to list all ECSchemas > load

[jira] [Resolved] (HDFS-10008) CLONE - Erasure coding: stateful (non-positional) read from files in striped layout

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10008. --- Resolution: Invalid > CLONE - Erasure coding: stateful (non-positional) read from files in striped >

[jira] [Resolved] (HDFS-10011) CLONE - Erasure coding: fix bug in EC zone and symlinks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10011. --- Resolution: Invalid > CLONE - Erasure coding: fix bug in EC zone and symlinks > --

[jira] [Resolved] (HDFS-10010) CLONE - Define a system-wide default EC schema

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10010. --- Resolution: Invalid > CLONE - Define a system-wide default EC schema > ---

[jira] [Resolved] (HDFS-10013) CLONE - Erasure coding: fix bug in TestFSImage

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10013. --- Resolution: Invalid > CLONE - Erasure coding: fix bug in TestFSImage > ---

[jira] [Resolved] (HDFS-10003) CLONE - Erasure Coding: simplify striped block recovery work computation and add tests

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10003. --- Resolution: Invalid > CLONE - Erasure Coding: simplify striped block recovery work computation and >

[jira] [Resolved] (HDFS-10002) CLONE - getStoragePolicy() regards HOT policy as EC policy

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10002. --- Resolution: Invalid > CLONE - getStoragePolicy() regards HOT policy as EC policy > ---

[jira] [Resolved] (HDFS-10005) CLONE - Erasure Coding: retrieve eraure coding schema for a file from NameNode

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10005. --- Resolution: Invalid > CLONE - Erasure Coding: retrieve eraure coding schema for a file from NameNode >

[jira] [Resolved] (HDFS-10004) CLONE - Erasure coding: extend UnderReplicatedBlocks to accurately handle striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10004. --- Resolution: Invalid > CLONE - Erasure coding: extend UnderReplicatedBlocks to accurately handle > str

[jira] [Resolved] (HDFS-10006) CLONE - Erasure Coding: ECworker frame, basics, bootstraping and configuration

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10006. --- Resolution: Invalid > CLONE - Erasure Coding: ECworker frame, basics, bootstraping and configuration >

[jira] [Resolved] (HDFS-9998) CLONE - Erasure Coding: INodeFile quota computation unit tests

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9998. -- Resolution: Invalid > CLONE - Erasure Coding: INodeFile quota computation unit tests > --

[jira] [Resolved] (HDFS-10000) CLONE - Erasure coding: NameNode support for lease recovery of striped block groups

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-1. --- Resolution: Invalid > CLONE - Erasure coding: NameNode support for lease recovery of striped block >

[jira] [Resolved] (HDFS-10001) CLONE - Erasure coding: DataNode support for block recovery of striped block groups

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-10001. --- Resolution: Invalid > CLONE - Erasure coding: DataNode support for block recovery of striped block >

[jira] [Resolved] (HDFS-9999) CLONE - WebImageViewer need support file size calculation with striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-. -- Resolution: Invalid > CLONE - WebImageViewer need support file size calculation with striped blocks > ---

[jira] [Resolved] (HDFS-9994) CLONE - Erasure Coding: track invalid, corrupt, and under-recovery striped blocks in NameNode

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9994. -- Resolution: Invalid > CLONE - Erasure Coding: track invalid, corrupt, and under-recovery striped > block

[jira] [Resolved] (HDFS-9996) CLONE - Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9996. -- Resolution: Invalid > CLONE - Erasure Coding: track BlockInfo instead of Block in > UnderReplicatedBlock

[jira] [Resolved] (HDFS-9995) CLONE - Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9995. -- Resolution: Invalid > CLONE - Erasure coding: use BlockInfo[] for both striped and contiguous > blocks i

[jira] [Resolved] (HDFS-9997) CLONE - Erasure coding: resolving conflicts in the branch when merging trunk changes.

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9997. -- Resolution: Invalid > CLONE - Erasure coding: resolving conflicts in the branch when merging trunk > cha

[jira] [Resolved] (HDFS-9992) CLONE - Erasure Coding: INodeFile.dumpTreeRecursively() supports to print striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9992. -- Resolution: Invalid > CLONE - Erasure Coding: INodeFile.dumpTreeRecursively() supports to print > stripe

[jira] [Resolved] (HDFS-9993) CLONE - Subclass DFSOutputStream to support writing striping layout files

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9993. -- Resolution: Invalid > CLONE - Subclass DFSOutputStream to support writing striping layout files > ---

[jira] [Resolved] (HDFS-9991) CLONE - Erasure Coding: Update safemode calculation for striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9991. -- Resolution: Invalid > CLONE - Erasure Coding: Update safemode calculation for striped blocks > --

[jira] [Resolved] (HDFS-9990) CLONE - Erasure coding: extend LocatedBlocks to support reading from striped files

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9990. -- Resolution: Invalid > CLONE - Erasure coding: extend LocatedBlocks to support reading from striped > fil

[jira] [Resolved] (HDFS-9988) CLONE - Erasure Coding: support striped blocks in non-protobuf fsimage

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9988. -- Resolution: Invalid > CLONE - Erasure Coding: support striped blocks in non-protobuf fsimage > --

[jira] [Resolved] (HDFS-9989) CLONE - Erasure coding: implement facilities in NameNode to create and manage EC zones

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9989. -- Resolution: Invalid > CLONE - Erasure coding: implement facilities in NameNode to create and manage > EC

[jira] [Resolved] (HDFS-9987) CLONE - Erasure Coding: allocate and persist striped blocks in NameNode

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9987. -- Resolution: Invalid > CLONE - Erasure Coding: allocate and persist striped blocks in NameNode > -

[jira] [Resolved] (HDFS-9986) CLONE - Erasure Coding: Update INodeFile quota computation for striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9986. -- Resolution: Invalid > CLONE - Erasure Coding: Update INodeFile quota computation for striped blocks > ---

[jira] [Resolved] (HDFS-9985) CLONE - Support appending to a striping layout file

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9985. -- Resolution: Invalid > CLONE - Support appending to a striping layout file > -

[jira] [Resolved] (HDFS-9982) CLONE - Add logic to DFSOutputStream to support writing a file in striping layout

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9982. -- Resolution: Invalid > CLONE - Add logic to DFSOutputStream to support writing a file in striping > layou

[jira] [Resolved] (HDFS-9983) CLONE - Erasure Coding: Add striped block support in INodeFile

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9983. -- Resolution: Invalid > CLONE - Erasure Coding: Add striped block support in INodeFile > --

[jira] [Resolved] (HDFS-9984) CLONE - Erasure coding: pread from files in striped layout

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9984. -- Resolution: Invalid > CLONE - Erasure coding: pread from files in striped layout > --

[jira] [Resolved] (HDFS-9980) CLONE - Add periodic checker to find the corrupted EC blocks/files

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9980. -- Resolution: Invalid > CLONE - Add periodic checker to find the corrupted EC blocks/files > --

[jira] [Resolved] (HDFS-9981) CLONE - Avoid Block movement in Balancer and Mover for the erasure encoded blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9981. -- Resolution: Invalid > CLONE - Avoid Block movement in Balancer and Mover for the erasure encoded > block

[jira] [Resolved] (HDFS-9978) CLONE - Change fsck to support EC files

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9978. -- Resolution: Invalid > CLONE - Change fsck to support EC files > --- >

[jira] [Resolved] (HDFS-9979) CLONE - Client side api/config changes to support online encoding

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9979. -- Resolution: Invalid > CLONE - Client side api/config changes to support online encoding > ---

[jira] [Resolved] (HDFS-9977) CLONE - Erasure coding: DFSInputStream with decode functionality (pread)

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9977. -- Resolution: Invalid > CLONE - Erasure coding: DFSInputStream with decode functionality (pread) >

[jira] [Resolved] (HDFS-9975) CLONE - Erasure Coding: update the Balancer/Mover data migration logic

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9975. -- Resolution: Invalid > CLONE - Erasure Coding: update the Balancer/Mover data migration logic > --

[jira] [Resolved] (HDFS-9976) CLONE - Erasure Coding: consolidate streamer coordination logic and handle failure when writing striped blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9976. -- Resolution: Invalid > CLONE - Erasure Coding: consolidate streamer coordination logic and handle > failu

[jira] [Resolved] (HDFS-9973) CLONE - Add unit tests for editlog transactions for EC

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9973. -- Resolution: Invalid > CLONE - Add unit tests for editlog transactions for EC > --

[jira] [Resolved] (HDFS-9972) CLONE - Add a test for BlockGroup support in FSImage

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9972. -- Resolution: Invalid > CLONE - Add a test for BlockGroup support in FSImage >

[jira] [Resolved] (HDFS-9974) CLONE - Change disk quota calculation for EC files

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9974. -- Resolution: Invalid > CLONE - Change disk quota calculation for EC files > --

[jira] [Resolved] (HDFS-9971) CLONE - Implement COMPLETE state of erasure coding block groups

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9971. -- Resolution: Invalid > CLONE - Implement COMPLETE state of erasure coding block groups > -

[jira] [Resolved] (HDFS-9970) CLONE - Erasure Coding: extend BlockInfo to handle EC info

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9970. -- Resolution: Invalid > CLONE - Erasure Coding: extend BlockInfo to handle EC info > --

[jira] [Resolved] (HDFS-9968) CLONE - Erasure coding: distribute recovery work for striped blocks to DataNode

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9968. -- Resolution: Invalid > CLONE - Erasure coding: distribute recovery work for striped blocks to > DataNode

[jira] [Resolved] (HDFS-9969) CLONE - Document the HDFS Erasure Coding feature

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9969. -- Resolution: Invalid > CLONE - Document the HDFS Erasure Coding feature >

[jira] [Resolved] (HDFS-9967) CLONE - [umbrella] Data striping support in HDFS client

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9967. -- Resolution: Invalid > CLONE - [umbrella] Data striping support in HDFS client > -

[jira] [Resolved] (HDFS-9966) CLONE - Process block reports for erasure coded blocks

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9966. -- Resolution: Invalid > CLONE - Process block reports for erasure coded blocks > --

[jira] [Resolved] (HDFS-9965) CLONE - Representing striped block groups in NameNode with hierarchical naming protocol

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9965. -- Resolution: Invalid > CLONE - Representing striped block groups in NameNode with hierarchical > naming p

[jira] [Resolved] (HDFS-9964) CLONE - Configurable erasure coding policy for individual files and directories

2016-03-15 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved HDFS-9964. -- Resolution: Invalid > CLONE - Configurable erasure coding policy for individual files and > directories

  1   2   3   4   >