[jira] [Created] (HDFS-10933) Refactor TestFsck

2016-09-29 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-10933: --- Summary: Refactor TestFsck Key: HDFS-10933 URL: https://issues.apache.org/jira/browse/HDFS-10933 Project: Hadoop HDFS Issue Type: Improvement

Re: Is anyone seeing this during trunk build?

2016-09-29 Thread Arun Suresh
It looks like *org.apache.hadoop.hdfs.StripeReader* is using a Java 8 lambda expression which commons bcel is still not comfortable with. As per https://issues.apache.org/jira/browse/BCEL-173 It should be fixed in commons release 6.0 of bcel. or maybe replace with bcel-findbugs ? as suggested by :

[jira] [Created] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-29 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10932: - Summary: Ozone : fix XceiverClient slow shutdown Key: HDFS-10932 URL: https://issues.apache.org/jira/browse/HDFS-10932 Project: Hadoop HDFS Issue Type: Sub-task

Re: Is anyone seeing this during trunk build?

2016-09-29 Thread Kihwal Lee
This also shows up in the precommit builds. This is not failing the build, so it might scroll over quickly before you realize. Search for ClassFormatException https://builds.apache.org/job/PreCommit-HDFS-Build/16928/artifact/patchprocess/branch-mvninstall-root.txt From: Ted Yu To: Kihwal

[jira] [Created] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-09-29 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10931: -- Summary: libhdfs++: Fix object lifecycle issues in the BlockReader Key: HDFS-10931 URL: https://issues.apache.org/jira/browse/HDFS-10931 Project: Hadoop HDFS

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-09-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/109/ [Sep 28, 2016 1:24:21 PM] (kihwal) HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn [Sep 28, 2016 6:47:37 PM] (arp) HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real [S

[jira] [Reopened] (HDFS-10595) libhdfs++: Client Name Protobuf Error

2016-09-29 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reopened HDFS-10595: --- Assignee: Bob Hansen On second thought, let me fix this issue here and see if the rest of the errors

[jira] [Resolved] (HDFS-10595) libhdfs++: Client Name Protobuf Error

2016-09-29 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen resolved HDFS-10595. --- Resolution: Duplicate Dupe of HDFS-9453 > libhdfs++: Client Name Protobuf Error > ---

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

2016-09-29 Thread Chris Trezzo
+1 Thanks Sangjin! 1. Verified md5 checksums and signature on src, and release tar.gz. 2. Built from source. 3. Started up a pseudo distributed cluster. 4. Successfully ran a PI job. 5. Ran the balancer. 6. Inspected UI for RM, NN, JobHistory. On Tue, Sep 27, 2016 at 4:11 PM, Lei Xu wrote: > +

[jira] [Created] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-09-29 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10930: - Summary: Refactor Datanode IO operations into a single class Key: HDFS-10930 URL: https://issues.apache.org/jira/browse/HDFS-10930 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-10929) Ozone:SCM: explore if we need 3 maps for tracking the state of nodes

2016-09-29 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10929: --- Summary: Ozone:SCM: explore if we need 3 maps for tracking the state of nodes Key: HDFS-10929 URL: https://issues.apache.org/jira/browse/HDFS-10929 Project: Hadoop HDFS

[jira] [Created] (HDFS-10928) Ozone:SCM: Support MXBean for SCM and NodeManager

2016-09-29 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10928: --- Summary: Ozone:SCM: Support MXBean for SCM and NodeManager Key: HDFS-10928 URL: https://issues.apache.org/jira/browse/HDFS-10928 Project: Hadoop HDFS Issue Typ

[jira] [Reopened] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-10609: Reopen to attach a branch-2.7 patch. > Uncaught InvalidEncryptionKeyException during pipeline r

Re: How to setup local environment to run kerberos test cases.

2016-09-29 Thread Steve Loughran
> On 29 Sep 2016, at 08:43, Yuanbo Liu wrote: > > Hi, Rakesh > Thanks for your response. Those docs are helpful but not what I'm asking. I > was running test cases in my local machine, some test cases threw > exception. > For example: >mvn clean package -Dtest=TestSecureNameNode > it threw:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-09-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/179/ [Sep 28, 2016 9:48:18 AM] (vvasudev) YARN-5662. Provide an option to enable ContainerMonitor. Contributed by [Sep 28, 2016 10:40:10 AM] (varunsaxena) YARN-5599. Publish AM launch command to ATS (Rohith Sha

[jira] [Created] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2016-09-29 Thread Nitin Goswami (JIRA)
Nitin Goswami created HDFS-10927: Summary: Lease Recovery: File not getting closed on HDFS when block write operation fails Key: HDFS-10927 URL: https://issues.apache.org/jira/browse/HDFS-10927 Projec

[jira] [Created] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc

2016-09-29 Thread SammiChen (JIRA)
SammiChen created HDFS-10926: Summary: Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc Key: HDFS-10926 URL: https://issues.apache.org/jira/browse/HDFS-10926

Re: How to setup local environment to run kerberos test cases.

2016-09-29 Thread Rakesh Radhakrishnan
May be its due to file permission issues or something else. The test uses MiniKdc, which is based on Apache Directory Server and is embedded in test cases. Could you share the complete logs of the failed test, I think you can look at the your machine/env location: $HADOOP_HOME/hadoop-hdfs-project/

[jira] [Created] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-09-29 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10925: Summary: Cache symlinkString in INodeSymlink Key: HDFS-10925 URL: https://issues.apache.org/jira/browse/HDFS-10925 Project: Hadoop HDFS Issue Type: Sub-task

Re: How to setup local environment to run kerberos test cases.

2016-09-29 Thread Yuanbo Liu
Hi, Rakesh Thanks for your response. Those docs are helpful but not what I'm asking. I was running test cases in my local machine, some test cases threw exception. For example: mvn clean package -Dtest=TestSecureNameNode it threw: Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:

Re: How to setup local environment to run kerberos test cases.

2016-09-29 Thread Rakesh Radhakrishnan
I hope the following documents will help you, it contains the details about the way to build and run hadoop test cases. Please take a look at it. https://github.com/apache/hadoop/blob/branch-2.7.3/BUILDING.txt http://hadoop.apache.org/docs/r2.7.3/hadoop-auth/BuildingIt.html Please give few more d

[jira] [Created] (HDFS-10924) Add a new instrumented read-write lock

2016-09-29 Thread Jingcheng Du (JIRA)
Jingcheng Du created HDFS-10924: --- Summary: Add a new instrumented read-write lock Key: HDFS-10924 URL: https://issues.apache.org/jira/browse/HDFS-10924 Project: Hadoop HDFS Issue Type: Improvem