Fwd: Apache Roadshow India in 2020?

2019-06-13 Thread Swapnil M Mane
Dear Hadoop Devs, Just for your information, we are exploring the possibility of Apache Roadshow India in 2020 [1]. Based on my knowledge, Hadoop community also having various members from India. If you and interested and want to give feedback or help with planning, please feel free to reply. As

[jira] [Created] (HADOOP-16373) Fix typo in FileSystemShell#test documentation

2019-06-13 Thread Dinesh Chitlangia (JIRA)
Dinesh Chitlangia created HADOOP-16373: -- Summary: Fix typo in FileSystemShell#test documentation Key: HADOOP-16373 URL: https://issues.apache.org/jira/browse/HADOOP-16373 Project: Hadoop Common

[jira] [Created] (HADOOP-16372) Fix typo in DFSUtil getHttpPolicy method

2019-06-13 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HADOOP-16372: --- Summary: Fix typo in DFSUtil getHttpPolicy method Key: HADOOP-16372 URL: https://issues.apache.org/jira/browse/HADOOP-16372 Project: Hadoop Common

Re: HDFS Scalability Limit?

2019-06-13 Thread Kihwal Lee
Hi Wei-Chiu, We have experience with 5,000 - 6,000 node clusters. Although it ran/runs fine, any heavy hitter activities such as decommissioning needed to be carefully planned. In terms of files and blocks, we have multiple clusters running stable with over 500M files and blocks. Some at over

[jira] [Created] (HADOOP-16371) Option to disable GCM for SSL connections when running on Java 8

2019-06-13 Thread Sahil Takiar (JIRA)
Sahil Takiar created HADOOP-16371: - Summary: Option to disable GCM for SSL connections when running on Java 8 Key: HADOOP-16371 URL: https://issues.apache.org/jira/browse/HADOOP-16371 Project: Hadoop

HDFS Scalability Limit?

2019-06-13 Thread Wei-Chiu Chuang
Hi community, I am currently drafting a HDFS scalability guideline doc, and I'd like to understand any data points regarding HDFS scalability limit. I'd like to share it publicly eventually. As an example, through my workplace, and through community chatters, I am aware that HDFS is capable of op

Re: [DISCUSS] HDFS roadmap/wish list

2019-06-13 Thread Wei-Chiu Chuang
Thank you. I really appreciate your feedback as I don't always know the detailed use case for a feature. (For me, it's mostly "hey, this thing is broken, fix it") What are the rest of the community thinks? This is a great opportunity to share what you think. My answers inline: On Wed, Jun 12, 20

[jira] [Created] (HADOOP-16370) S3AFileSystem copyFile to propagate etag/version from getObjectMetadata to copy request

2019-06-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16370: --- Summary: S3AFileSystem copyFile to propagate etag/version from getObjectMetadata to copy request Key: HADOOP-16370 URL: https://issues.apache.org/jira/browse/HADOOP-16370

[jira] [Created] (HADOOP-16369) Fix zstandard shortname misspelled as zts

2019-06-13 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created HADOOP-16369: Summary: Fix zstandard shortname misspelled as zts Key: HADOOP-16369 URL: https://issues.apache.org/jira/browse/HADOOP-16369 Project: Hadoop Common I

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/351/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check