Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Takanobu Asanuma
There are two PRs for the Dynamometer test. https://github.com/apache/hadoop/pull/2471 (HADOOP-17375) https://github.com/apache/hadoop/pull/2622 (HADOOP-17472) The problem is not only that the tarball doesn't exist. Please see Erik's comment in #2622. I will go over it again. - Takanobu 2021年4月

[jira] [Created] (HDFS-16004) startLogSegment and journal in BackupNode lack Permission check.

2021-04-29 Thread lujie (Jira)
lujie created HDFS-16004: Summary: startLogSegment and journal in BackupNode lack Permission check. Key: HDFS-16004 URL: https://issues.apache.org/jira/browse/HDFS-16004 Project: Hadoop HDFS Issue T

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2021-04-29 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/161/ [Apr 27, 2021 10:15:52 AM] (noreply) HADOOP-17536. ABFS: Supporting customer provided encryption key (#2707) [Apr 27, 2021 12:01:53 PM] (Peter Bacsko) YARN-10739. GenericEventHandler.printEventQueue

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Wei-Chiu Chuang
Thanks all! On Thu, Apr 29, 2021 at 3:08 PM Ayush Saxena wrote: > Sorry the number was HADOOP-16524 > > https://issues.apache.org/jira/browse/HADOOP-16524 > > Sent from my iPhone > > > On 29-Apr-2021, at 12:35 PM, Xiaoqiao He wrote: > > > >  > > Thanks Wei-Chiu raise this discussion here. I wo

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2021-04-29 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/492/ [Apr 28, 2021 3:44:13 AM] (noreply) YARN-10747. Bump YARN CSI protobuf version to 3.7.1 (#2946) -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsyste

Re: [E] Re: Java 8 Lambdas

2021-04-29 Thread Jim Brennan
I just think that we should be cognizant of changes (particularly bug fixes), that will need to be ported to branch-2.10. Since it is still on Java7, anytime you use a lambda in code on trunk, we need to change it for branch-2.10. While not difficult, this is extra work and it increases the diff

[jira] [Resolved] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15561. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2021-04-29 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/283/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc

[jira] [Created] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-04-29 Thread lei w (Jira)
lei w created HDFS-16003: Summary: ProcessReport print invalidatedBlocks should judge debug level at first Key: HDFS-16003 URL: https://issues.apache.org/jira/browse/HDFS-16003 Project: Hadoop HDFS

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Ayush Saxena
Sorry the number was HADOOP-16524 https://issues.apache.org/jira/browse/HADOOP-16524 Sent from my iPhone > On 29-Apr-2021, at 12:35 PM, Xiaoqiao He wrote: > >  > Thanks Wei-Chiu raise this discussion here. I would like to be involved to > fix them. > > > For example, Dynamometer test are fa

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Xiaoqiao He
Thanks Wei-Chiu raise this discussion here. I would like to be involved to fix them. > For example, Dynamometer test are failing because it fetches from a mirror that no longer exists. For Dynamometer, I am not sure why not fetch resources from apache directly, any load consideration? or we should