Re: Updated 2.8.0-SNAPSHOT artifact

2016-11-09 Thread Karthik Kambatla
If there is interest in releasing off of branch-2.8, we should definitely do that. As Sangjin mentioned, there might be value in doing 2.9 off branch-2 too. How do we go about maintenance releases along those minor lines, and when would we discontinue 2.6.x/2.7.x releases? On Wed, Nov 9, 2016 at

[jira] [Created] (HDFS-11124) Report blockIds of internal blocks for EC files in Fsck

2016-11-09 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-11124: --- Summary: Report blockIds of internal blocks for EC files in Fsck Key: HDFS-11124 URL: https://issues.apache.org/jira/browse/HDFS-11124 Project: Hadoop HDFS

Re: [DISCUSS] Release cadence and EOL

2016-11-09 Thread Karthik Kambatla
Fair points, Sangjin and Andrew. To get the ball rolling on this, I am willing to try the proposed policy. On Fri, Nov 4, 2016 at 12:09 PM, Andrew Wang wrote: > I'm certainly willing to try this policy. There's definitely room for > improvement when it comes to streamlining the release process.

[jira] [Created] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-11-09 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11123: -- Summary: [SPS] Make storage policy satisfier daemon work on/off dynamically Key: HDFS-11123 URL: https://issues.apache.org/jira/browse/HDFS-11123 Project:

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Roman Shaposhnik
On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang wrote: > Nice work Kai! Quick comment: have you considered Bigtop? It allows > creating a multi-node docker cluster too. But I'm not sure if Bigtop takes > a custom built Hadoop (from the instructions I read, it builds from a > certain git branch; I'm not

Re: Updated 2.8.0-SNAPSHOT artifact

2016-11-09 Thread Ming Ma
I would also prefer releasing current 2.8 branch sooner. There are several incomplete features in branch-2 such as YARN-914 and HDFS-7877 that are better served if we can complete them in the next major release. Letting them span across multiple releases might not be desirable as there could be som

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-11-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/150/ [Nov 8, 2016 3:25:10 PM] (brahma) HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not [Nov 8, 2016 10:01:26 PM] (jlowe) YARN-5356. NodeManager should communicate physical resource capability [Nov

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Zhe Zhang
Nice work Kai! Quick comment: have you considered Bigtop? It allows creating a multi-node docker cluster too. But I'm not sure if Bigtop takes a custom built Hadoop (from the instructions I read, it builds from a certain git branch; I'm not sure if that customizable). On Wed, Nov 9, 2016 at 5:39 A

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/220/ [Nov 8, 2016 9:27:56 AM] (varunsaxena) MAPREDUCE-6782. JHS task page search based on each individual column not [Nov 8, 2016 3:25:10 PM] (brahma) HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is n

Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Sasaki Kai
Hi Hadoop developers The other day I created a tool for launching multiple node hadoop cluster on docker container. You can easily launch multiple node hadoop cluster from your Hadoop source code. It is useful for testing and debugging. Actually I often use it before submitting a patch to Hado

[jira] [Created] (HDFS-11122) TestDFSAdmin.testReportCommand fails due to timed out

2016-11-09 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11122: Summary: TestDFSAdmin.testReportCommand fails due to timed out Key: HDFS-11122 URL: https://issues.apache.org/jira/browse/HDFS-11122 Project: Hadoop HDFS Issue Type: