Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-11-13 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/

[Nov 12, 2020 6:55:35 PM] (Wei-Chiu Chuang) HADOOP-17358. Improve excessive 
reloading of Configurations (#2436)




-1 overall


The following subsystems voted -1:
asflicense hadolint jshint pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   hadoop-build-tools/src/main/resources/checkstyle/checkstyle.xml 
   hadoop-build-tools/src/main/resources/checkstyle/suppressions.xml 
   
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml
 
   hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml 
   hadoop-tools/hadoop-azure/src/config/checkstyle.xml 
   hadoop-tools/hadoop-resourceestimator/src/config/checkstyle.xml 
   hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml
 

Failed junit tests :

   hadoop.util.TestDiskCheckerWithDiskIo 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.balancer.TestBalancer 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
   hadoop.yarn.server.resourcemanager.TestApplicationMasterService 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.tools.TestDistCpSystem 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
  

   jshint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-patch-jshint.txt
  [208K]

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-compile-javac-root.txt
  [456K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-checkstyle-root.txt
  [16M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-patch-pylint.txt
  [60K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-patch-shellcheck.txt
  [56K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-patch-shelldocs.txt
  [8.0K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/whitespace-tabs.txt
  [1.3M]

   xml:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/xml.txt
  [4.0K]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/diff-javadoc-javadoc-root.txt
  [20K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [216K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [276K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [12K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/115/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [36K]

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-11-13 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/

[Nov 12, 2020 6:52:36 AM] (noreply) Revert "HADOOP-17269. [JDK 11] Upgrade 
SpotBugs to 4.1.3 to fix false-positive warnings. (#2374)" (#2460)
[Nov 12, 2020 7:13:12 PM] (noreply) HADOOP-17346. Fair call queue is defeated 
by abusive service principals (#2431)
[Nov 12, 2020 10:57:26 PM] (noreply) HDFS-15545 - Allow WebHdfsFileSystem to 
read a new delegation token f… (#2255)




-1 overall


The following subsystems voted -1:
pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

Failed junit tests :

   hadoop.hdfs.TestStripedFileAppend 
   hadoop.hdfs.server.datanode.TestBPOfferService 
   hadoop.yarn.server.router.webapp.TestRouterWebServicesREST 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.tools.dynamometer.TestDynamometerInfra 
   hadoop.tools.dynamometer.TestDynamometerInfra 
   hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 
   hadoop.fs.azure.TestNativeAzureFileSystemMocked 
   hadoop.fs.azure.TestBlobMetadata 
   hadoop.fs.azure.TestNativeAzureFileSystemConcurrency 
   hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck 
   hadoop.fs.azure.TestNativeAzureFileSystemContractMocked 
   hadoop.fs.azure.TestWasbFsck 
   hadoop.fs.azure.TestOutOfBandAzureBlobOperations 
   hadoop.yarn.sls.appmaster.TestAMSimulator 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-compile-cc-root.txt
  [48K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-compile-javac-root.txt
  [568K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-checkstyle-root.txt
  [16M]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-patch-pylint.txt
  [60K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-patch-shelldocs.txt
  [44K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/whitespace-eol.txt
  [13M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/whitespace-tabs.txt
  [2.0M]

   xml:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/xml.txt
  [24K]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/diff-javadoc-javadoc-root.txt
  [2.0M]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [376K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-router.txt
  [36K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
  [16K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer_hadoop-dynamometer-infra.txt
  [8.0K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/324/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer.txt
  [24

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC2

2020-11-13 Thread Chao Sun 
+1 (non-binding) from me as well:

- download the source and build it on mac successfully
- verified all md5, sha512 as well as signatures, however @Xiaoqiao I was
not able to find your public key in
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS so had to use the
other link.
- started a single-node HDFS cluster with docker and verified that basic
operations are working
- checked the NN webui and it is working as expected

Thanks,
Chao


On Tue, Nov 10, 2020 at 1:13 PM Stephen O'Donnell
 wrote:

> I compiled a native build from source and started a non-HA, non-HA secure
> (TLS and Kerberos) and a HA hdfs cluster using docker.
>
> On each, I created a few files, looked around the webUI etc. Everything
> looks fine. The only strange thing, was on the Namenode webUI under the
> overview section - the "unknown" is a little strange, but I am not sure
> what is usually in there:
>
> Version: 3.2.2, rUnknown
> Compiled: Mon Nov 09 17:30:00 + 2020 by root from Unknown
>
> +1 from me.
>
> Stephen.
>
> On Sat, Nov 7, 2020 at 2:52 PM Xiaoqiao He  wrote:
>
> > Hi folks,
> >
> > The release candidate (RC2) for Hadoop-3.2.2 is available now.
> > There are two commits[1] differences between RC2 and RC1[2](Thanks Akira
> > Ajisaka for the report.):
> > * revert HADOOP-17306.
> > * include HDFS-15643.
> >
> > The RC2 is available at:
> > http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC2
> > The RC2 tag in github is here:
> > https://github.com/apache/hadoop/tree/release-3.2.2-RC2
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1288
> >
> > You can find my public key at:
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS or
> > https://people.apache.org/keys/committer/hexiaoqiao.asc directly.
> >
> > Please try the release and vote. The vote will close until 2020/11/14 at
> > 00:00 CST.
> >
> > Thanks,
> > He Xiaoqiao
> >
> > [1]
> >
> >
> https://github.com/apache/hadoop/compare/release-3.2.2-RC1...release-3.2.2-RC2
> > [2]
> >
> >
> https://lists.apache.org/thread.html/rc7247434f5a77b6d0d1d1f3fcd6b6668eb431a5697e582a6338f0eb7%40%3Chdfs-dev.hadoop.apache.org%3E
> > [3]
> >
> https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335948
> >
>

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC2

2020-11-13 Thread Wei-Chiu Chuang 
I suggest we wait for HDFS-15680

(If I understand it correctly, it's a blocker)

I wish to update jetty too in this release, but it's turning out to be more
involved than i had anticipated.


On Fri, Nov 13, 2020 at 3:22 PM Chao Sun  wrote:

> +1 (non-binding) from me as well:
>
> - download the source and build it on mac successfully
> - verified all md5, sha512 as well as signatures, however @Xiaoqiao I was
> not able to find your public key in
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS so had to use the
> other link.
> - started a single-node HDFS cluster with docker and verified that basic
> operations are working
> - checked the NN webui and it is working as expected
>
> Thanks,
> Chao
>
>
> On Tue, Nov 10, 2020 at 1:13 PM Stephen O'Donnell
>  wrote:
>
>> I compiled a native build from source and started a non-HA, non-HA secure
>> (TLS and Kerberos) and a HA hdfs cluster using docker.
>>
>> On each, I created a few files, looked around the webUI etc. Everything
>> looks fine. The only strange thing, was on the Namenode webUI under the
>> overview section - the "unknown" is a little strange, but I am not sure
>> what is usually in there:
>>
>> Version: 3.2.2, rUnknown
>> Compiled: Mon Nov 09 17:30:00 + 2020 by root from Unknown
>>
>> +1 from me.
>>
>> Stephen.
>>
>> On Sat, Nov 7, 2020 at 2:52 PM Xiaoqiao He  wrote:
>>
>> > Hi folks,
>> >
>> > The release candidate (RC2) for Hadoop-3.2.2 is available now.
>> > There are two commits[1] differences between RC2 and RC1[2](Thanks Akira
>> > Ajisaka for the report.):
>> > * revert HADOOP-17306.
>> > * include HDFS-15643.
>> >
>> > The RC2 is available at:
>> > http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC2
>> > The RC2 tag in github is here:
>> > https://github.com/apache/hadoop/tree/release-3.2.2-RC2
>> > The maven artifacts are staged at:
>> > https://repository.apache.org/content/repositories/orgapachehadoop-1288
>> >
>> > You can find my public key at:
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS or
>> > https://people.apache.org/keys/committer/hexiaoqiao.asc directly.
>> >
>> > Please try the release and vote. The vote will close until 2020/11/14 at
>> > 00:00 CST.
>> >
>> > Thanks,
>> > He Xiaoqiao
>> >
>> > [1]
>> >
>> >
>> https://github.com/apache/hadoop/compare/release-3.2.2-RC1...release-3.2.2-RC2
>> > [2]
>> >
>> >
>> https://lists.apache.org/thread.html/rc7247434f5a77b6d0d1d1f3fcd6b6668eb431a5697e582a6338f0eb7%40%3Chdfs-dev.hadoop.apache.org%3E
>> > [3]
>> >
>> https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335948
>> >
>>
>