Re: Upgrading minimum version of Maven to 3.1 from 3.0

2017-04-03 Thread Akira Ajisaka
As I mentioned in YARN-6421. I'm +1 for upgrading to 3.1+ because the latest version of Maven 3.0.x is quite old. (4 years ago) We need to update dev-support/docker/Dockerfile to enable Maven 3.1+ for precommit Jenkins job. Regards, Akira On 2017/04/03 18:49, Sunil G wrote: Hi Folks, Recent

[jira] [Created] (HDFS-11618) Block Storage: Add Support for Direct I/O

2017-04-03 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-11618: Summary: Block Storage: Add Support for Direct I/O Key: HDFS-11618 URL: https://issues.apache.org/jira/browse/HDFS-11618 Project: Hadoop HDFS Issue T

[jira] [Resolved] (HDFS-8832) Document hdfs crypto cli changes

2017-04-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8832. -- Resolution: Not A Problem > Document hdfs crypto cli changes > > >

[jira] [Resolved] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

2017-04-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8747. -- Resolution: Duplicate Fix Version/s: 2.8.0 > Provide Better "Scratch Space" and "Soft Delete" Supp

Re: Automated documentation build for Apache Hadoop

2017-04-03 Thread Andrew Wang
Nice work Akira! Appreciate the help with trunk development. On Mon, Apr 3, 2017 at 1:56 AM, Akira Ajisaka wrote: > Hi folks, > > I've created a repository to build and push Apache Hadoop document (trunk) > via Travis CI. > https://github.com/aajisaka/hadoop-document > > The document is updated

Re: [DISCUSS] Changing the default class path for clients

2017-04-03 Thread Andrew Wang
Thanks for digging that up. I agree with your analysis of our public documentation, though we still need a transition path. Officially, our classpath is not covered by compatibility, though we know that in reality, classpath changes are quite impactful to users. While we were having a related disc

[jira] [Created] (HDFS-11617) Datanode should delete the block from rbw direcotry when it finds duplicate in finalized directory.

2017-04-03 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-11617: - Summary: Datanode should delete the block from rbw direcotry when it finds duplicate in finalized directory. Key: HDFS-11617 URL: https://issues.apache.org/jira/browse/HDFS-1161

Apache Hadoop 2.8.1 Release Plan

2017-04-03 Thread Junping Du
Hi all, We just released Apache Hadoop 2.8.0 recently [1] but it is not for production yet due to some issues identified. Now, we should work towards 2.8.1 release which aim for production deployment. The focus obviously is to fix blocker/critical issues [2], bug-fixes and *no* features / imp

[jira] [Created] (HDFS-11616) Namenode doesn't mark the block as non-corrupt if the reason for corruption was INVALID_STATE

2017-04-03 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-11616: - Summary: Namenode doesn't mark the block as non-corrupt if the reason for corruption was INVALID_STATE Key: HDFS-11616 URL: https://issues.apache.org/jira/browse/HDFS-11616

[jira] [Created] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due millisecond precision

2017-04-03 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-11615: -- Summary: FSNamesystemLock metrics can be inaccurate due millisecond precision Key: HDFS-11615 URL: https://issues.apache.org/jira/browse/HDFS-11615 Project: Hadoop HDFS

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-04-03 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/365/ [Apr 3, 2017 4:06:54 AM] (aajisaka) MAPREDUCE-6824. TaskAttemptImpl#createCommonContainerLaunchContext is -1 overall The following subsystems voted -1: asflicense unit The following subsystems v

[jira] [Created] (HDFS-11614) Ozone: Cleanup javadoc issues

2017-04-03 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11614: --- Summary: Ozone: Cleanup javadoc issues Key: HDFS-11614 URL: https://issues.apache.org/jira/browse/HDFS-11614 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11613) Ozone: Cleanup findbugs issues

2017-04-03 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11613: --- Summary: Ozone: Cleanup findbugs issues Key: HDFS-11613 URL: https://issues.apache.org/jira/browse/HDFS-11613 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11612) Ozone: Cleanup Checkstyle issues

2017-04-03 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11612: --- Summary: Ozone: Cleanup Checkstyle issues Key: HDFS-11612 URL: https://issues.apache.org/jira/browse/HDFS-11612 Project: Hadoop HDFS Issue Type: Sub-task

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2017-04-03 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/277/ [Apr 3, 2017 4:06:54 AM] (aajisaka) MAPREDUCE-6824. TaskAttemptImpl#createCommonContainerLaunchContext is -1 overall The following subsystems voted -1: compile unit The following subsystems vote

Re: [DISCUSS] Changing the default class path for clients

2017-04-03 Thread Allen Wittenauer
1.0.4: "Prints the class path needed to get the Hadoop jar and the required libraries.” 2.8.0 and 3.0.0: "Prints the class path needed to get the Hadoop jar and the required libraries. If called without arguments, then prints the classpath set up by the command scripts, whic

Re: [DISCUSS] Changing the default class path for clients

2017-04-03 Thread Esteban Gutierrez
I agreed with Andrew too. Users have relied for years on `hadoop classpath` for their script to launch jobs or other tools, perhaps no the best idea to change the behavior without providing a proper deprecation path. thanks! esteban. -- Cloudera, Inc. On Mon, Apr 3, 2017 at 10:26 AM, Andrew Wan

Re: [DISCUSS] Changing the default class path for clients

2017-04-03 Thread Andrew Wang
What's the current contract for `hadoop classpath`? Would it be safer to introduce `hadoop userclasspath` or similar for this behavior? I'm betting that changing `hadoop classpath` will lead to some breakages, so I'd prefer to make this new behavior opt-in. Best, Andrew On Mon, Apr 3, 2017 at 9:

[DISCUSS] Changing the default class path for clients

2017-04-03 Thread Allen Wittenauer
This morning I had a bit of a shower thought: With the new shaded hadoop client in 3.0, is there any reason the default classpath should remain the full blown jar list? e.g., shouldn’t ‘hadoop classpath’ just return configuration, user supplied bits (e.g., HADOOP_USER_CLASSPAT

[jira] [Created] (HDFS-11611) Handle unsuccessful encode and decode calls

2017-04-03 Thread JIRA
László Bence Nagy created HDFS-11611: Summary: Handle unsuccessful encode and decode calls Key: HDFS-11611 URL: https://issues.apache.org/jira/browse/HDFS-11611 Project: Hadoop HDFS Issue

Upgrading minimum version of Maven to 3.1 from 3.0

2017-04-03 Thread Sunil G
Hi Folks, Recently we were doing build framework up-gradation for Yarn Ui. In order to compile yarn-ui on various architectures, we were using frontend-maven-plugin 0.0.22 version. However build is failing in *ppc64le.* If we could use latest version of frontend-maven-plugin, we could resolve this

Automated documentation build for Apache Hadoop

2017-04-03 Thread Akira Ajisaka
Hi folks, I've created a repository to build and push Apache Hadoop document (trunk) via Travis CI. https://github.com/aajisaka/hadoop-document The document is updated daily by Travis CI cron job. https://aajisaka.github.io/hadoop-document/hadoop-project/ Hope it helps! Regards, Akira -

[jira] [Created] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2017-04-03 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-11610: Summary: sun.net.spi.nameservice.NameService has moved to a new location Key: HDFS-11610 URL: https://issues.apache.org/jira/browse/HDFS-11610 Project: Hadoop HDFS