[jira] [Created] (HDFS-12405) Complete remove "removed" state erasure coding policy during Namenode restart

2017-09-07 Thread SammiChen (JIRA)
SammiChen created HDFS-12405: Summary: Complete remove "removed" state erasure coding policy during Namenode restart Key: HDFS-12405 URL: https://issues.apache.org/jira/browse/HDFS-12405 Project: Hadoop H

[jira] [Resolved] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDFS-11744. -- Resolution: Duplicate This has already been fixed. Duping it > Ozone: Implement the tra

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-07 Thread Vinod Kumar Vavilapalli
Thanks for starting this thread, Wangda! +1 for establishing a faster cadence now itself. One word of caution though. The same I expressed while we were trying to do both 2.8 and 3.0 releases at the same time. Please try avoiding concurrent releases and splitting community bandwidth - it's not

Re: [DISCUSS] Looking to a 2.9.0 release

2017-09-07 Thread Vrushali C
As I mentioned in the [VOTE] thread at [1], for Timeline Service v2, we are thinking about merging to branch2 some time in the next couple of weeks. So far, we have been maintaining a branch2 based YARN-5355_branch2 along with our trunk based feature branch YARN-5355. Varun Saxena has been dilig

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

2017-09-07 Thread Vrushali C
Thanks everyone. It has been over a week (~9 days) since TSv2 has been merged to trunk with no problems thus far. We are now thinking about merging timeline service v2 to branch2 some time in the next few weeks. So far, we have been maintaining a branch2 based YARN-5355_branch2 along with our tru

2017-09-07 Hadoop 3 release status update

2017-09-07 Thread Andrew Wang
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-09-07 Slightly early update since I'll be out tomorrow. We're one week out, and focus is on blocker burndown. Highlights: - 3.1.0 release planning is underway, led by Wangda. Target release date is in

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-07 Thread Andrew Wang
Hi folks, This vote closes today. I see a -1 from Allen on inclusion in beta1. I see there's active fixing going on, but given that we're one week out from RC0, I think we should drop this from beta1. Allen, Jian, others, is this reasonable? What release should we retarget this for? I don't have

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-07 Thread Wangda Tan
Thanks for all your valuable feedbacks. Regarding to security issues for alpha features: I completely agree with Larry: ideally, all alpha features should be disabled by default. Steve/Arun/Haibo: could you please comment about feature's rough merge plan and status (like alpha/beta). I will wait

Re: [DISCUSS] Looking to a 2.9.0 release

2017-09-07 Thread Iñigo Goiri
Hi Subru, We are also discussing the merge of HDFS-10467 (Router-based federation) and we would like to target 2.9 to do a full release together with YARN federation. Chris Douglas already arranged the integration into trunk for 3.0.0 GA. Regarding the points to cover: 1. API compatibility: we jus

[jira] [Created] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12404: Summary: Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider Key: HDFS-12404 URL: https://issues.apache.org/jira/browse/HD

Re: DISCUSS: Hadoop Compatability Guidelines

2017-09-07 Thread Andrew Wang
There's also the DataNode data directory layout. FS edit logs should also be included if we're including the fsimage. Historically we've bumped these in minor and major releases, though I'm not sure whether precedent supports the practice. It means you can't downgrade, and features that need metad

Re: DISCUSS: Hadoop Compatability Guidelines

2017-09-07 Thread Steve Loughran
On 7 Sep 2017, at 19:13, Daniel Templeton mailto:dan...@cloudera.com>> wrote: Good point. I think it would be valuable to enumerate the policies around the versioned state stores. We have the three you listed. We should probably include the HDFS fsimage in that list. Any others? S3Guard n

Re: DISCUSS: Hadoop Compatability Guidelines

2017-09-07 Thread Daniel Templeton
Good point.  I think it would be valuable to enumerate the policies around the versioned state stores.  We have the three you listed. We should probably include the HDFS fsimage in that list.  Any others? I also want to add a section that clarifies when it's OK to change the visibility or audi

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/516/ [Sep 6, 2017 6:51:51 AM] (cdouglas) HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. [Sep 6, 2017 8:19:34 PM] (junping_du) YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc erro