Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Takanobu Asanuma
There are two PRs for the Dynamometer test. https://github.com/apache/hadoop/pull/2471 (HADOOP-17375) https://github.com/apache/hadoop/pull/2622 (HADOOP-17472) The problem is not only that the tarball doesn't exist. Please see Erik's comment in #2622. I will go over it again. - Takanobu 2021年4月

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Wei-Chiu Chuang
Thanks all! On Thu, Apr 29, 2021 at 3:08 PM Ayush Saxena wrote: > Sorry the number was HADOOP-16524 > > https://issues.apache.org/jira/browse/HADOOP-16524 > > Sent from my iPhone > > > On 29-Apr-2021, at 12:35 PM, Xiaoqiao He wrote: > > > >  > > Thanks Wei-Chiu raise this discussion here. I wo

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Ayush Saxena
Sorry the number was HADOOP-16524 https://issues.apache.org/jira/browse/HADOOP-16524 Sent from my iPhone > On 29-Apr-2021, at 12:35 PM, Xiaoqiao He wrote: > >  > Thanks Wei-Chiu raise this discussion here. I would like to be involved to > fix them. > > > For example, Dynamometer test are fa

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-29 Thread Xiaoqiao He
Thanks Wei-Chiu raise this discussion here. I would like to be involved to fix them. > For example, Dynamometer test are failing because it fetches from a mirror that no longer exists. For Dynamometer, I am not sure why not fetch resources from apache directly, any load consideration? or we should

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-28 Thread Nan
I am interested in fixing those too. Let me take a look. On Wed, Apr 28, 2021, 11:39 PM Ayush Saxena wrote: > I have a PR to fix a couple of HDFS ones as part of HDFS-15988. Give a > check if it helps somewhere. > > The dynamometer one yep is trouble. There is a jira tracking that AFAIK. I > don

Re: [DISCUSS] Looking for help fix flaky tests

2021-04-28 Thread Ayush Saxena
I have a PR to fix a couple of HDFS ones as part of HDFS-15988. Give a check if it helps somewhere. The dynamometer one yep is trouble. There is a jira tracking that AFAIK. I don’t recall the number though. TestJournalNode is broken by HADOOP-16254 Other seems failing once in a while. Let me

[DISCUSS] Looking for help fix flaky tests

2021-04-28 Thread Wei-Chiu Chuang
Hello, There are a number of bad tests currently. https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/490/testReport/ Most are HDFS UTs and are almostly failing consistently. For example, Dynamometer test are failing because it fetches from a mirror that no longer exists. I am