[jira] [Created] (HADOOP-13610) Clean up AliyunOss integration tests

2016-09-13 Thread Kai Zheng (JIRA)
Kai Zheng created HADOOP-13610: -- Summary: Clean up AliyunOss integration tests Key: HADOOP-13610 URL: https://issues.apache.org/jira/browse/HADOOP-13610 Project: Hadoop Common Issue Type: Sub-ta

[jira] [Created] (HADOOP-13609) Refine credential provider related codes for AliyunOss integration

2016-09-13 Thread Kai Zheng (JIRA)
Kai Zheng created HADOOP-13609: -- Summary: Refine credential provider related codes for AliyunOss integration Key: HADOOP-13609 URL: https://issues.apache.org/jira/browse/HADOOP-13609 Project: Hadoop Comm

[jira] [Resolved] (HADOOP-13594) findbugs warnings to block a build

2016-09-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-13594. - Resolution: Not A Bug > findbugs warnings to block a build > ---

[jira] [Created] (HADOOP-13608) DelegationTokenAuthenticationFilter doesn't provide the impersonator information

2016-09-13 Thread Hrishikesh Gadre (JIRA)
Hrishikesh Gadre created HADOOP-13608: - Summary: DelegationTokenAuthenticationFilter doesn't provide the impersonator information Key: HADOOP-13608 URL: https://issues.apache.org/jira/browse/HADOOP-13608

[jira] [Resolved] (HADOOP-7198) Hadoop defaults for web UI ports often fall smack in the middle of Linux ephemeral port range

2016-09-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HADOOP-7198. - Resolution: Duplicate Believe this is handled by HDFS-9427 and related JIRAs. Resolving; any rem

[jira] [Created] (HADOOP-13607) Specify and test contract for FileSystem#close.

2016-09-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13607: -- Summary: Specify and test contract for FileSystem#close. Key: HADOOP-13607 URL: https://issues.apache.org/jira/browse/HADOOP-13607 Project: Hadoop Common

Re: how about syncing namenode metadata to glusterfs?

2016-09-13 Thread Kihwal Lee
We do. :) Yes, it needs other fencing method. Kihwal From: Andrew Wang To: Zhe Zhang Cc: Levi Nie ; "common-dev@hadoop.apache.org" Sent: Tuesday, September 13, 2016 12:46 PM Subject: Re: how about syncing namenode metadata to glusterfs? This is a similar idea to NFS HA, which yo

[jira] [Created] (HADOOP-13606) swift FS to add a service load metadata file

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13606: --- Summary: swift FS to add a service load metadata file Key: HADOOP-13606 URL: https://issues.apache.org/jira/browse/HADOOP-13606 Project: Hadoop Common

[jira] [Created] (HADOOP-13605) Clean up FileSystem javadocs, logging; improve diagnostics on FS load

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13605: --- Summary: Clean up FileSystem javadocs, logging; improve diagnostics on FS load Key: HADOOP-13605 URL: https://issues.apache.org/jira/browse/HADOOP-13605 Project

[jira] [Created] (HADOOP-13604) Abort retry loop when RPC has an unrecoverable error

2016-09-13 Thread Henry Robinson (JIRA)
Henry Robinson created HADOOP-13604: --- Summary: Abort retry loop when RPC has an unrecoverable error Key: HADOOP-13604 URL: https://issues.apache.org/jira/browse/HADOOP-13604 Project: Hadoop Common

Re: how about syncing namenode metadata to glusterfs?

2016-09-13 Thread Andrew Wang
This is a similar idea to NFS HA, which you can read about here: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html This is definitely less preferred compared to using QJM, since you need an external mechanism for fencing writes. FWIW, I don't k

[jira] [Created] (HADOOP-13603) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created HADOOP-13603: Summary: Remove package line length checkstyle rule Key: HADOOP-13603 URL: https://issues.apache.org/jira/browse/HADOOP-13603 Project: Hadoop Common Issue Ty

[jira] [Created] (HADOOP-13602) Fix findbugs warning in hadoop-maven-plugin

2016-09-13 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13602: --- Summary: Fix findbugs warning in hadoop-maven-plugin Key: HADOOP-13602 URL: https://issues.apache.org/jira/browse/HADOOP-13602 Project: Hadoop Common I

[jira] [Created] (HADOOP-13601) Typo in a log messages

2016-09-13 Thread Mehran Hassani (JIRA)
Mehran Hassani created HADOOP-13601: --- Summary: Typo in a log messages Key: HADOOP-13601 URL: https://issues.apache.org/jira/browse/HADOOP-13601 Project: Hadoop Common Issue Type: Bug

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-09-13 Thread Allen Wittenauer
> On Sep 13, 2016, at 7:31 AM, Apache Jenkins Server > wrote: > > For more details, see > https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/163/ > > unit: > > > > https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/163/artifact/out/patch-unit-hadoop-mapreduc

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-09-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/163/ [Sep 12, 2016 3:26:08 PM] (raviprak) HADOOP-13587. distcp.map.bandwidth.mb is overwritten even when [Sep 12, 2016 6:10:00 PM] (aw) HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with [Sep 12, 201

Re: how about syncing namenode metadata to glusterfs?

2016-09-13 Thread Zhe Zhang
Hi Levi, This clearly should go to hdfs-dev instead of common-dev. Just using an HA storage for fsimage won't allow HDFS work without the current NN-HA framework. After all fsimage is only a checkpoint of NameNode state. On Tue, Sep 13, 2016 at 2:19 AM Levi Nie wrote: > Use glusterfs instead of

[jira] [Created] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13600: --- Summary: S3a rename() to copy files in a directory in parallel Key: HADOOP-13600 URL: https://issues.apache.org/jira/browse/HADOOP-13600 Project: Hadoop Common

how about syncing namenode metadata to glusterfs?

2016-09-13 Thread Levi Nie
Use glusterfs instead of disk to keep fsimage, will it work without HA?

[jira] [Created] (HADOOP-13599) s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13599: --- Summary: s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown Key: HADOOP-13599 URL: https://issues.apache.org/jira/browse/HADOOP-13599 Pro