[jira] [Resolved] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8145. - Resolution: Fixed Fix Version/s: HDFS-7285 I've committed this to the feature branch. Thanks for the

[jira] [Resolved] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7937. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this to the fe

[jira] [Resolved] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8166. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks Nicholas for the review! I've committed this to th

[jira] [Reopened] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-8166: - Assignee: Jing Zhao (was: Tsz Wo Nicholas Sze) Reopen the jira. We will separate out the fix for DFSStri

HDFS writes a lot to disks

Hi, I am running some PIG queries atop Tez atop Yarn. My PIG query has a large stage which reads 45 GB data, and outputs less than 1 MB.  The stage is processed by 200 tasks, on 9 machines cluster with up to 8 tasks running in parallel, each with 7 GB memory. I am monitoring the resource usage

[jira] [Created] (HDFS-8179) DFSClient#getServerDefaults returns within 1 hour of NN start

Xiaoyu Yao created HDFS-8179: Summary: DFSClient#getServerDefaults returns within 1 hour of NN start Key: HDFS-8179 URL: https://issues.apache.org/jira/browse/HDFS-8179 Project: Hadoop HDFS Issu

[jira] [Resolved] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8172. --- Resolution: Duplicate > Failure handling: DFSStripedOutputStream continues writing with

[jira] [Resolved] (HDFS-8167) BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

[ https://issues.apache.org/jira/browse/HDFS-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8167. - Resolution: Fixed > BlockManager.addBlockCollectionWithCheck should check if the block is a > striped bloc

[jira] [Created] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

Zhe Zhang created HDFS-8178: --- Summary: QJM doesn't purge empty and corrupt inprogress edits files Key: HDFS-8178 URL: https://issues.apache.org/jira/browse/HDFS-8178 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-8177) When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception statin

[ https://issues.apache.org/jira/browse/HDFS-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8177. - Resolution: Not A Problem Hi [~bharath.r25], HDFS supports single writer at a time for a given file

[jira] [Created] (HDFS-8177) When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception stating

bharath created HDFS-8177: - Summary: When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception stating file cannot be created since File already exists

[jira] [Created] (HDFS-8176) Provide information about the snapshots compared in audit log

J.Andreina created HDFS-8176: Summary: Provide information about the snapshots compared in audit log Key: HDFS-8176 URL: https://issues.apache.org/jira/browse/HDFS-8176 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8175) Provide information on snapshotDiff for supporting the comparison between snapshot and current status

J.Andreina created HDFS-8175: Summary: Provide information on snapshotDiff for supporting the comparison between snapshot and current status Key: HDFS-8175 URL: https://issues.apache.org/jira/browse/HDFS-8175

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #157

See Changes: [wang] HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. [aajisaka] MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. [wheat

Hadoop-Hdfs-trunk-Java8 - Build # 157 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/157/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5191 lines...] [INFO] [INFO] --- maven-source-plugi

Build failed in Jenkins: Hadoop-Hdfs-trunk #2098

See Changes: [wang] HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. [aajisaka] MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. [wheat9] HD

Hadoop-Hdfs-trunk - Build # 2098 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2098/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5190 lines...] [INFO] [INFO] --- maven-source-plugin:2.3

[jira] [Created] (HDFS-8174) Update replication count to live rep count in fsck report

J.Andreina created HDFS-8174: Summary: Update replication count to live rep count in fsck report Key: HDFS-8174 URL: https://issues.apache.org/jira/browse/HDFS-8174 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-8173) NPE thrown at DataNode startup.

Archana T created HDFS-8173: --- Summary: NPE thrown at DataNode startup. Key: HDFS-8173 URL: https://issues.apache.org/jira/browse/HDFS-8173 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Created] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

Li Bo created HDFS-8172: --- Summary: Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes Key: HDFS-8172 URL: https://issues.apache.org/jira/browse/HDFS-8172 Project: Hadoop

[jira] [Resolved] (HDFS-8170) Erasure Coding: Keep default schema's name consistent

[ https://issues.apache.org/jira/browse/HDFS-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8170. - Resolution: Duplicate > Erasure Coding: Keep default schema's name consistent > ---

[jira] [Created] (HDFS-8171) Extend BlockSender to support multiple block data source

Li Bo created HDFS-8171: --- Summary: Extend BlockSender to support multiple block data source Key: HDFS-8171 URL: https://issues.apache.org/jira/browse/HDFS-8171 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-8170) Erasure Coding: Keep default schema's name consistent

Walter Su created HDFS-8170: --- Summary: Erasure Coding: Keep default schema's name consistent Key: HDFS-8170 URL: https://issues.apache.org/jira/browse/HDFS-8170 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-8169) Move LocatedBlocks and related classes to hdfs-client

Haohui Mai created HDFS-8169: Summary: Move LocatedBlocks and related classes to hdfs-client Key: HDFS-8169 URL: https://issues.apache.org/jira/browse/HDFS-8169 Project: Hadoop HDFS Issue Type: S

[jira] [Created] (HDFS-8167) BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

Tsz Wo Nicholas Sze created HDFS-8167: - Summary: BlockManager.addBlockCollectionWithCheck should check if the block is a striped block Key: HDFS-8167 URL: https://issues.apache.org/jira/browse/HDFS-8167