RE: Question About Feasibility of Hadoop Over P2P Architecture

2020-09-21 Thread Lauren Taylor
Hello! I am currently provisioning a P2P peer network (there are already a couple of live networks that have been created, but we do not want to test this in production, fo course). In this p2p network, I was looking at the best ways in which one could distribute file storage (and access it to) i

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
jojochuang commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492286560 ## File path: pom.xml ## @@ -95,6 +95,7 @@ org.apache.hadoop.thirdparty ${shaded.prefix}.protobuf 3.7.1 +27.0-jre Review commen

[GitHub] [hadoop-thirdparty] ayushtkn commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
ayushtkn commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492300681 ## File path: pom.xml ## @@ -95,6 +95,7 @@ org.apache.hadoop.thirdparty ${shaded.prefix}.protobuf 3.7.1 +27.0-jre Review comment:

[GitHub] [hadoop-thirdparty] ayushtkn commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
ayushtkn commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492440814 ## File path: hadoop-shaded-guava/pom.xml ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; + xmlns:xsi="http://www.w3.org/2001/X

[GitHub] [hadoop-thirdparty] ayushtkn commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
ayushtkn commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492440814 ## File path: hadoop-shaded-guava/pom.xml ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; + xmlns:xsi="http://www.w3.org/2001/X

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-21 Thread Masatake Iwasaki
The vote passed with 6 binging +1's and 2 non-binding +1's. Thanks all for pushing this. I'm going to publish the release. binding +1's: - Eric Payne - Sunil Govindan - Wei-Chiu Chuang - Vinayakumar B - Mingliang Liu - Masatake Iwasaki non-binding +1's: - Jim Brennan - Eric Badger Bests, Masa

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
jojochuang commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492364864 ## File path: hadoop-shaded-guava/pom.xml ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; + xmlns:xsi="http://www.w3.org/2001

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
jojochuang commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492363544 ## File path: hadoop-shaded-guava/pom.xml ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; + xmlns:xsi="http://www.w3.org/2001

[jira] [Resolved] (HADOOP-17259) Allow SSLFactory fallback to input config if ssl-*.xml fail to load from classpath

2020-09-21 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HADOOP-17259. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks [~ste...@apach

[GitHub] [hadoop-thirdparty] ayushtkn commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
ayushtkn commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492300681 ## File path: pom.xml ## @@ -95,6 +95,7 @@ org.apache.hadoop.thirdparty ${shaded.prefix}.protobuf 3.7.1 +27.0-jre Review comment:

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
jojochuang commented on a change in pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8#discussion_r492286560 ## File path: pom.xml ## @@ -95,6 +95,7 @@ org.apache.hadoop.thirdparty ${shaded.prefix}.protobuf 3.7.1 +27.0-jre Review commen

[GitHub] [hadoop-thirdparty] ayushtkn opened a new pull request #8: HADOOP-17278. Shade guava 27.0-jre in hadoop thirdparty.

2020-09-21 Thread GitBox
ayushtkn opened a new pull request #8: URL: https://github.com/apache/hadoop-thirdparty/pull/8 https://issues.apache.org/jira/browse/HADOOP-17278 This is an automated message from the Apache Git Service. To respond to the

[jira] [Created] (HADOOP-17278) Shade guava 27.0-jre in hadoop thirdparty

2020-09-21 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-17278: - Summary: Shade guava 27.0-jre in hadoop thirdparty Key: HADOOP-17278 URL: https://issues.apache.org/jira/browse/HADOOP-17278 Project: Hadoop Common Issue T

Re: [DISCUSS] Ozone TLP proposal

2020-09-21 Thread Elek, Marton
Thank you all the feedback and update. If there is no more comments, I will start the vote on Thursday. Thanks, Marton On 9/7/20 2:04 PM, Elek, Marton wrote: Hi, The Hadoop community earlier decided to move out Ozone sub-project to a separated Apache Top Level Project (TLP). [1] For detai

Remove whitelist/blacklist terminology from Hadoop

2020-09-21 Thread Eric Badger
Hi, Could I get some people to review this JIRA? It is a large patch and touches a lot of files. Additionally, it makes some incompatible changes, notably changing the names of config keys. https://issues.apache.org/jira/browse/HADOOP-17169 Eric

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-09-21 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/272/ [Sep 20, 2020 3:24:25 AM] (Ayush Saxena) HDFS-15579. RBF: The constructor of PathLocation may got some misunderstanding. Contributed by Janus Chow. [Sep 20, 2020 6:10:05 AM] (noreply) MAPREDUCE-7294.

[jira] [Resolved] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17023. - Fix Version/s: 3.3.1 Resolution: Fixed Available in 3.3.1+. > Tune listStatus

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-09-21 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/63/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: c

[jira] [Resolved] (HADOOP-17216) hadoop-aws having FileNotFoundException when accessing AWS s3 occassionally

2020-09-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17216. - Fix Version/s: 3.3.0 Resolution: Duplicate > hadoop-aws having FileNotFoundExcep

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-21 Thread Mingliang Liu
+1 (binding) 1. Download binary and check signature / checksum successfully 2. Create a 3 node cluster in Docker containers and start the HDFS/YARN services 3. Verify the running version 4. Run simple HDFS/YARN client/admin commands and verify the output 5. Run example programs wordcount and grep

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-21 Thread Vinayakumar B
Apologies for delayed voting. +1 (Binding) 1. Verified the signature. Signatures are good. 2. Verified the sha512 checksum (I tried to use the sha512sum tool to verify. But ".sha512" files doesn't have the expected format. I guess these files are regenerated using "gpg --print-md", not