Restrict Frequency of BlockReport To Namenode startup and failover

2020-02-04 Thread Ayush Saxena
Hi All, Me and Surendra have been lately trying to minimise the impact of Block Reports on Namenode in huge cluster. We observed in a huge cluster, about 10k datanodes, the periodic block reports impact the Namenode performance adversely. We have been thinking to restrict the block reports to be

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

2020-02-04 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/587/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc c

[jira] [Created] (HADOOP-16838) Support for `fs.s3a.endpoint.region`

2020-02-04 Thread Nitish (Jira)
Nitish created HADOOP-16838: --- Summary: Support for `fs.s3a.endpoint.region` Key: HADOOP-16838 URL: https://issues.apache.org/jira/browse/HADOOP-16838 Project: Hadoop Common Issue Type: New Feature

[jira] [Resolved] (HADOOP-16838) Support for `fs.s3a.endpoint.region`

2020-02-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16838. - Resolution: Invalid > Support for `fs.s3a.endpoint.region` > --

[jira] [Reopened] (HADOOP-16838) Support for `fs.s3a.endpoint.region`

2020-02-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-16838: - > Support for `fs.s3a.endpoint.region` > > >

[jira] [Resolved] (HADOOP-16838) Support for `fs.s3a.endpoint.region`

2020-02-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16838. - Resolution: Works for Me > Support for `fs.s3a.endpoint.region` > -

[jira] [Created] (HADOOP-16839) SparkLauncher does not read SPARK_CONF_DIR/spark-defaults.conf

2020-02-04 Thread Koji Noguchi (Jira)
Koji Noguchi created HADOOP-16839: - Summary: SparkLauncher does not read SPARK_CONF_DIR/spark-defaults.conf Key: HADOOP-16839 URL: https://issues.apache.org/jira/browse/HADOOP-16839 Project: Hadoop C

[jira] [Resolved] (HADOOP-11610) hadoop-common build fails on JDK9

2020-02-04 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-11610. - Resolution: Won't Fix > hadoop-common build fails on JDK9 > - >

[jira] [Created] (HADOOP-16840) AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket

2020-02-04 Thread wujinhu (Jira)
wujinhu created HADOOP-16840: Summary: AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket Key: HADOOP-16840 URL: https://issues.apache.org/jira/browse/HADOOP-16840 Project: Hadoop

Re: [VOTE] Apache Hadoop Ozone 0.4.2-alpha RC0

2020-02-04 Thread Dinesh Chitlangia
The vote ended with lone vote of 0 from Marton. As highlighted by Marton, artifacts with Snapshot dependencies can't be uploaded to Maven Central, we will roll out a new RC after ratis-0.5 has been released. Issue of missing README will also be addressed in the new RC. Thank you. Dinesh On Thu,

[jira] [Created] (HADOOP-16841) The description of hadoop.http.authentication.signature.secret.file contains outdated information

2020-02-04 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-16841: -- Summary: The description of hadoop.http.authentication.signature.secret.file contains outdated information Key: HADOOP-16841 URL: https://issues.apache.org/jira/browse/HADOOP-