Re: [DISCUSS] Merge YARN resource profile (YARN-3926) branch into trunk

2017-08-18 Thread Wangda Tan
Hi Andrew, This feature can be disabled, It is off by default. The major change of existing code path it Resource YARN PB record related implementations, we did lots of tests around this regarding to performances and safety of these changes, so far so good (please refer to my email regarding to pe

Re: [DISCUSS] Merge YARN resource profile (YARN-3926) branch into trunk

2017-08-18 Thread Andrew Wang
Hi Wangda, Can this feature be disabled? Is it on or off by default? We're 1 month from the target release for beta1, so I don't want to introduce risk to existing code paths. TSv2 and S3Guard and YARN Federation are all okay in that regard. I'm also not clear on what work is remaining, there are

Re: [DISCUSS] Merge YARN resource profile (YARN-3926) branch into trunk

2017-08-17 Thread Wangda Tan
+hdfs/common/mr On Thu, Aug 17, 2017 at 1:28 PM, Wangda Tan wrote: > Hi all, > > I want to hear your thoughts of merging YARN resource profile branch into > trunk in the next few weeks. The goal is to get it in for Hadoop 3.0 beta1. > > *Regarding to testing:* > We did extensive tests for the fe