Re: Branch merges and 3.0.0-beta1 scope

2017-08-18 Thread Vinod Kumar Vavilapalli
Andrew, Each of the branches below have been created more than a year ago (!) and have been consistently worked upon and are now finally seeing the light of the day. When they are "few weeks” away, pushing them out by 7 *more* months just doesn’t make sense. While I deeply appreciate the push

Branch merges and 3.0.0-beta1 scope

2017-08-18 Thread Andrew Wang
Hi folks, As you might have seen, we've had a number of branch merges floated this past week targeted for 3.0.0-beta1, which is planned for about a month from now. In total, I'm currently tracking these branches: YARN-2915: YARN federation (recently merged) HADOOP-13345: S3Guard (currently being

Re: [DISCUSS] Merge YARN resource profile (YARN-3926) branch into trunk

2017-08-18 Thread Wangda Tan
Hi Andrew, This feature can be disabled, It is off by default. The major change of existing code path it Resource YARN PB record related implementations, we did lots of tests around this regarding to performances and safety of these changes, so far so good (please refer to my email regarding to pe

Re: [DISCUSS] Merge yarn-native-services branch into trunk

2017-08-18 Thread Andrew Wang
Hi Jian, thanks for the reply, On Thu, Aug 17, 2017 at 1:03 PM, Jian He wrote: > Thanks Andrew for the comments. Answers below: > > - There are no new APIs added in YARN/Hadoop core. In fact, all the new > code are running outside of existing system and they are optional and > require users to e

Re: [DISCUSS] Merge YARN resource profile (YARN-3926) branch into trunk

2017-08-18 Thread Andrew Wang
Hi Wangda, Can this feature be disabled? Is it on or off by default? We're 1 month from the target release for beta1, so I don't want to introduce risk to existing code paths. TSv2 and S3Guard and YARN Federation are all okay in that regard. I'm also not clear on what work is remaining, there are

[jira] [Resolved] (HADOOP-9856) Avoid Krb5LoginModule.logout issue

2017-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HADOOP-9856. - Resolution: Duplicate Release Note: Incorporated into parent jira. > Avoid Krb5LoginModule.

[jira] [Resolved] (HADOOP-9852) UGI login user keytab and principal should not be static

2017-08-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HADOOP-9852. - Resolution: Duplicate Incorporated into parent jira. > UGI login user keytab and principal shoul

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-18 Thread Sangjin Lee
Kudos to Vrushali and the team for getting ready for this large and important feature! I know a huge team effort went into this. I look forward to seeing this merged. I'd like to ask one piece of due diligence. Could you please inspect rigorously to ensure that when disabled Timeline Service v.2 d

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-18 Thread John Zhuge
That will be great. Please record it if possible. On Fri, Aug 18, 2017 at 4:12 AM, Steve Loughran wrote: > > I can do a demo of this next week if people are interested > > > On 17 Aug 2017, at 23:07, Aaron Fabbri wrote: > > > > Hello, > > > > I'd like to open a vote (7 days, ending August 24 at

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-08-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/496/ [Aug 17, 2017 8:05:19 AM] (jzhuge) HADOOP-14560. Make HttpServer2 backlog size configurable. Contributed by [Aug 17, 2017 9:37:15 AM] (sunilg) YARN-3254. HealthReport should include disk full information.

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-18 Thread Steve Loughran
I can do a demo of this next week if people are interested > On 17 Aug 2017, at 23:07, Aaron Fabbri wrote: > > Hello, > > I'd like to open a vote (7 days, ending August 24 at 3:10 PST) to merge the > HADOOP-13345 feature branch into trunk. > > This branch contains the new S3Guard feature whic