Hadoop encryption module as Apache Chimera incubator project

Hi Devs, Some of our Hadoop developers working with Spark community to implement the shuffle encryption. While implementing that, they realized some/most of the code in Hadoop encryption code and their implemention code have to be duplicated. This leads to an idea to create separate library,

[jira] [Created] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

ade created HDFS-9661: - Summary: Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw Key: HDFS-9661 URL: https://issues.apache.org/jira/browse/HDFS-9661 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9660) TestBlockScanner.testScanRateLimit fails intermittently

Yongjun Zhang created HDFS-9660: --- Summary: TestBlockScanner.testScanRateLimit fails intermittently Key: HDFS-9660 URL: https://issues.apache.org/jira/browse/HDFS-9660 Project: Hadoop HDFS Issue

Build failed in Jenkins: Hadoop-Hdfs-trunk #2742

See Changes: [jianhe] YARN-4596. SystemMetricPublisher should not swallow error messages from [wangda] Revert "YARN-4502. Fix two AM containers get allocated when AM restart. [wangda] YARN-4502. Fix two AM containers get allocated w

Hadoop-Hdfs-trunk - Build # 2742 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2742/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5390 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1 (binding) - verified signatures - Installed pseudo-cluster from binary distribution and ran example MapReduce jobs - Built from sources and reran tests on pseudo-cluster On 1/14/16, 8:57 PM, "Vinod Kumar Vavilapalli" wrote: >Hi all, > >I've created an updated release candidate RC2 for Ap

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #805

See Changes: [jianhe] YARN-4596. SystemMetricPublisher should not swallow error messages from [wangda] Revert "YARN-4502. Fix two AM containers get allocated when AM restart. [wangda] YARN-4502. Fix two AM containers get alloca

Hadoop-Hdfs-trunk-Java8 - Build # 805 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/805/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7231 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1 (non-binding) - Downloaded source tarball - Successfully built from source tarball - Deployed on a pseudo cluster - Ran simple HDFS commands and a Hadoop streaming job successfully. Thanks a lot Vinod! Regards,Kuhu On Saturday, January 16, 2016 6:58 PM, Junping Du wrote: In addition

Hadoop-Hdfs-trunk - Build # 2741 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2741/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5390 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2741

See Changes: [cnauroth] HADOOP-12635. Adding Append API support for WASB. Contributed by -- [...truncated 5197 lines...] Running org.apache.hadoop.hdfs.TestFileAppend3 Tests run: 15, Failures:

Hadoop-Hdfs-trunk-Java8 - Build # 804 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/804/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5990 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #804

See Changes: [cnauroth] HADOOP-12635. Adding Append API support for WASB. Contributed by -- [...truncated 5797 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.

Build failed in Jenkins: Hadoop-Hdfs-trunk #2740

See Changes: [kasha] YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. -- [...truncated 5220 lines...] Running org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding Test

Hadoop-Hdfs-trunk - Build # 2740 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2740/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5413 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #803

See

Hadoop-Hdfs-trunk - Build # 2739 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2739/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5533 lines...] [INFO] [INFO] --- maven-antrun-plugin:1.7

Build failed in Jenkins: Hadoop-Hdfs-trunk #2739

See Changes: [wangda] Revert "YARN-4502. Fix two AM containers get allocated when AM restart. [wangda] Move YARN-4524 from 2.9 to 2.8 [wangda] YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod -

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #802

See Changes: [wangda] Revert "YARN-4502. Fix two AM containers get allocated when AM restart. [wangda] Move YARN-4524 from 2.9 to 2.8 [wangda] YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod

Hadoop-Hdfs-trunk-Java8 - Build # 802 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/802/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6707 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

[jira] [Created] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

Surendra Singh Lilhore created HDFS-9659: Summary: EditLogTailerThread to Active Namenode RPC should timeout Key: HDFS-9659 URL: https://issues.apache.org/jira/browse/HDFS-9659 Project: Hadoop

[jira] [Created] (HDFS-9658) Erasure Coding: make tests compatible with multiple EC policies [Part 1]

Rui Li created HDFS-9658: Summary: Erasure Coding: make tests compatible with multiple EC policies [Part 1] Key: HDFS-9658 URL: https://issues.apache.org/jira/browse/HDFS-9658 Project: Hadoop HDFS I

Hadoop-Hdfs-trunk - Build # 2738 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2738/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5406 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2738

See Changes: [wangda] YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A [wangda] YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod [wangda] YARN-4304. AM max resource configuration per pa

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #801

See

[jira] [Created] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

Li Bo created HDFS-9657: --- Summary: Schedule EC tasks at proper time to reduce the impact of recovery traffic Key: HDFS-9657 URL: https://issues.apache.org/jira/browse/HDFS-9657 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-9656) Hadoop-tools jars should be included in the classpath of hadoop command

Liu Shaohui created HDFS-9656: - Summary: Hadoop-tools jars should be included in the classpath of hadoop command Key: HDFS-9656 URL: https://issues.apache.org/jira/browse/HDFS-9656 Project: Hadoop HDFS