Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2020-10-16 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/30/ [Oct 14, 2020 8:00:37 AM] (Xiaoqiao He) HADOOP-17304. KMS ACL: Allow DeleteKey Operation to Invalidate Cache. Contributed by Xiaoyu. [Oct 14, 2020 10:26:04 PM] (Kihwal Lee) HDFS-15628. HttpFS server t

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Sunil Govindan
Yes. I ran a compilation and it also failed. This is an issue when we do maven set version command because hadoop.version in the parent pom also needs to be set. 3.2.2-SNAPSHOT On Sat, Oct 17, 2020 at 12:15 AM Eric Badger wrote: > Hi Xiaoqiao, > > I believe that > https://github.com/apache/hado

Re: Collect feedback for HDFS-15638

2020-10-16 Thread Xinli shang
Thanks Owen for your reply! As mentioned in the Jira, default ACLs don't apply to rename. Any idea how rename can work without setting ACLs per file? On Fri, Oct 16, 2020 at 7:25 PM Owen O'Malley wrote: > I'm very -1 on adding these semantics. > > When you create the table's directory, set the d

Re: Collect feedback for HDFS-15638

2020-10-16 Thread Owen O'Malley
I'm very -1 on adding these semantics. When you create the table's directory, set the default ACL. That will have exactly the effect that you are looking for without creating additional semantics. .. Owen On Fri, Oct 16, 2020 at 7:02 PM Xinli shang wrote: > Hi all, > > I opened https://issues.

Collect feedback for HDFS-15638

2020-10-16 Thread Xinli shang
Hi all, I opened https://issues.apache.org/jira/browse/HDFS-15638 and want to collect feedback from the community. I know whenever changing the permission model that follows POSIX model is never a trivial change. So please comment on if you have concerns. For reading convenience, here is a copy of

[jira] [Created] (HDFS-15638) Make Hive tables directory permission check flat

2020-10-16 Thread Xinli Shang (Jira)
Xinli Shang created HDFS-15638: -- Summary: Make Hive tables directory permission check flat Key: HDFS-15638 URL: https://issues.apache.org/jira/browse/HDFS-15638 Project: Hadoop HDFS Issue Type:

MDFS

2020-10-16 Thread David
Hello HDFS Gang, I've been playing around with a POC for a new distributed file system based on a lot of lessons learned from various Apache projects. You, also being a data nerd, I just wanted to share some thoughts with you since you may find it interesting. https://github.com/belugabehr/mdfs/

Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-16 Thread Chao Sun
Thanks for the replies all! > But in the opposite case, it might have problem, because 2.x server may not understand new client calls added in 3.x Yes not expecting this to work. I'm thinking about the case where one upgrades existing 2.x clients to 3.x and expects it to still work against 2.x se

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Eric Badger
Hi Xiaoqiao, I believe that https://github.com/apache/hadoop/commit/3274fd139d9b612e449fc234f8804a2a97ae6c47 broke compilation for branch-3.2. Looks like you missed a 3.2.2 -> 3.2.3 in pom.xml in the top-level directory. https://github.com/apache/hadoop/blob/3274fd139d9b612e449fc234f8804a2a97ae6c

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-10-16 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/297/ [Oct 15, 2020 5:57:43 PM] (Eric Badger) YARN-10450. Add cpu and memory utilization per node and cluster-wide metrics. -1 overall The following subsystems voted -1: pathlen unit xml The fol

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-10-16 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/88/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: c

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Sunil Govindan
Looks good to me. Thanks Xiaoquio. + Sunil On Fri, Oct 16, 2020 at 12:36 PM Xiaoqiao He wrote: > Thanks Sunil for your reminder, > > branch-3.2.2 is ready now [1] and also mark branch-3.2 to 'prepare for > 3.2.3 development' [2]. > Please help to give another check if you have time. > > Thanks

[jira] [Created] (HDFS-15637) Viewfs should make mount-table to read from central place

2020-10-16 Thread Junfan Zhang (Jira)
Junfan Zhang created HDFS-15637: --- Summary: Viewfs should make mount-table to read from central place Key: HDFS-15637 URL: https://issues.apache.org/jira/browse/HDFS-15637 Project: Hadoop HDFS I

[jira] [Resolved] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15636. Resolution: Duplicate Duplicate with HDFS-14383 > NameNode computes load by group when choosing datanodes.

[jira] [Created] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
Jinglun created HDFS-15636: -- Summary: NameNode computes load by group when choosing datanodes. Key: HDFS-15636 URL: https://issues.apache.org/jira/browse/HDFS-15636 Project: Hadoop HDFS Issue Type:

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Xiaoqiao He
Thanks Sunil for your reminder, branch-3.2.2 is ready now [1] and also mark branch-3.2 to 'prepare for 3.2.3 development' [2]. Please help to give another check if you have time. Thanks. [1] https://github.com/apache/hadoop/commits/branch-3.2.2 [2] https://github.com/apache/hadoop/commits/branch