Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/ [Jul 28, 2021 11:04:46 PM] (Konstantin Shvachko) HADOOP-17819. Add extensions to ProtobufRpcEngine RequestHeaderProto. Contributed by Hector Sandoval Chaverri. (#3242) -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.fs.TestTrash hadoop.fs.TestFileUtil hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.TestDFSClientRetries hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.tools.TestDistCpSystem hadoop.yarn.sls.appmaster.TestAMSimulator hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.service.TestResourceEstimatorService hadoop.resourceestimator.solver.impl.TestLpSolver cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-compile-javac-root.txt [496K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-checkstyle-root.txt [14M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-mvnsite-root.txt [584K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-patch-pylint.txt [48K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-patch-shellcheck.txt [56K] shelldocs: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-patch-shelldocs.txt [48K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/diff-javadoc-javadoc-root.txt [20K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [236K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [428K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [40K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [112K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [96K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [104K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/374/artifact/out/patch-unit-hadoop-to
Experiment Recruitment
Hi, I would invite you to participate in an experiment. It requires no more than 20 mins and it's rewarded with 5$. Follow the link below. Thank you in advance https://twitter.com/larissabrazb/status/1420334645191880707 [photo-logo] Fernando Petrulio PhD Student University of Zurich UZH Department of Informatics [linkedin] https://www.linkedin.com/in/fernando-petrulio
[jira] [Resolved] (HADOOP-17815) Run CI for Centos 7
[ https://issues.apache.org/jira/browse/HADOOP-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HADOOP-17815. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Run CI for Centos 7 > --- > > Key: HADOOP-17815 > URL: https://issues.apache.org/jira/browse/HADOOP-17815 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Affects Versions: 3.4.0 >Reporter: Gautham Banasandra >Assignee: Gautham Banasandra >Priority: Critical > Labels: pull-request-available > Fix For: 3.4.0 > > Attachments: build-log-centos-7.zip > > Time Spent: 3.5h > Remaining Estimate: 0h > > Need to run the CI for Centos 7 platform since it's a supported platform. The > CI will run on this platform only when there's C++ file/C++ build/platform > related changes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17820) Remove dependency on jdom
Siyao Meng created HADOOP-17820: --- Summary: Remove dependency on jdom Key: HADOOP-17820 URL: https://issues.apache.org/jira/browse/HADOOP-17820 Project: Hadoop Common Issue Type: Improvement Reporter: Siyao Meng Assignee: Siyao Meng It doesn't seem that jdom is referenced anywhere in the code base now, yet it exists in the distribution. {code} $ find . -name "*jdom*.jar" ./hadoop-3.4.0-SNAPSHOT/share/hadoop/tools/lib/jdom-1.1.jar {code} There is recently [CVE-2021-33813|https://github.com/advisories/GHSA-2363-cqg2-863c] issued for jdom. Let's remove the binary from the dist if not useful. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/ [Jul 28, 2021 4:59:00 AM] (noreply) HDFS-16145. CopyListing fails with FNF exception with snapshot diff. (#3234) [Jul 28, 2021 10:18:04 AM] (noreply) HDFS-16137.Improve the comments related to FairCallQueue#queues. (#3226) [Jul 28, 2021 12:49:10 PM] (Szilard Nemeth) YARN-10727. ParentQueue does not validate the queue on removal. Contributed by Andras Gyori [Jul 28, 2021 1:49:23 PM] (Stephen O'Donnell) HDFS-16144. Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions). Contributed by Stephen O'Donnell [Jul 28, 2021 2:34:43 PM] (noreply) HADOOP-17817. S3A to raise IOE if both S3-CSE and S3Guard enabled (#3239) [Jul 28, 2021 2:50:14 PM] (Szilard Nemeth) YARN-10790. CS Flexible AQC: Add separate parent and leaf template property. Contributed by Andras Gyori [Jul 28, 2021 3:02:15 PM] (Szilard Nemeth) YARN-6272. TestAMRMClient#testAMRMClientWithContainerResourceChange fails intermittently. Contributed by Andras Gyory & Prabhu Joseph [Jul 28, 2021 5:10:07 PM] (noreply) HADOOP-17814. Provide fallbacks for identity/cost providers and backoff enable (#3230) [Jul 28, 2021 7:22:58 PM] (noreply) HADOOP-17811: ABFS ExponentialRetryPolicy doesn't pick up configuration values (#3221) [Jul 28, 2021 10:37:56 PM] (Konstantin Shvachko) HADOOP-17819. Add extensions to ProtobufRpcEngine RequestHeaderProto. Contributed by Hector Sandoval Chaverri. (#3242) -1 overall The following subsystems voted -1: asflicense blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.hdfs.server.balancer.TestBalancerService hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup hadoop.hdfs.server.blockmanagement.TestBlockInfoStriped hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId hadoop.hdfs.server.mover.TestStorageMover hadoop.hdfs.server.mover.TestMover hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf hadoop.hdfs.server.federation.router.TestRouterFsck hadoop.hdfs.server.federation.router.TestRouterWithSecureStartup hadoop.hdfs.server.federation.router.TestRouterRpcMultiDestination hadoop.fs.contract.router.web.TestRouterWebHDFSContractConcat hadoop.fs.contract.router.web.TestRouterWebHDFSContractCreate hadoop.hdfs.server.federation.router.TestRouterRPCClientRetries hadoop.hdfs.server.federation.router.TestRouterMountTableCacheRefresh hadoop.hdfs.server.federation.router.TestRouterFederationRename hadoop.hdfs.server.federation.router.TestRouterWebHdfsMethods hadoop.hdfs.server.federation.router.TestRouterMountTable hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.TestDynamometerInfra cc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/results-compile-cc-root.txt [96K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/results-compile-javac-root.txt [364K] blanks: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/blanks-eol.txt [13M] https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/blanks-tabs.txt [2.0M] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/results-checkstyle-root.txt [14M] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/583/artifact/out/results-pathlen.txt [16K]
Apache Hadoop qbt Report: branch-3.3+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/ No changes -1 overall The following subsystems voted -1: asflicense blanks mvninstall mvnsite pathlen spotbugs unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.metrics2.source.TestJvmMetrics hadoop.fs.TestWebHdfsFileContextMainOperations hadoop.hdfs.TestReadStripedFileWithDNFailure hadoop.hdfs.TestReconstructStripedFileWithValidator hadoop.hdfs.TestClientProtocolForPipelineRecovery hadoop.hdfs.TestReadStripedFileWithDecoding hadoop.fs.viewfs.TestViewFileSystemLinkRegex hadoop.hdfs.TestWriteRead hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy hadoop.fs.loadGenerator.TestLoadGenerator hadoop.yarn.applications.distributedshell.TestDSWithMultipleNodeManager hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapreduce.v2.TestUberAM hadoop.mapred.TestJobCounters hadoop.mapreduce.TestMRJobClient hadoop.mapred.TestNetworkedJob hadoop.yarn.csi.client.TestCsiClient hadoop.tools.TestCopyListing hadoop.tools.mapred.TestCopyMapperCompositeCrc hadoop.tools.dynamometer.workloadgenerator.TestWorkloadGenerator hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.workloadgenerator.TestWorkloadGenerator hadoop.fs.azurebfs.services.TestAbfsClientThrottlingAnalyzer mvninstall: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/patch-mvninstall-root.txt [1.6M] cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-compile-cc-root.txt [48K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-compile-javac-root.txt [392K] blanks: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/blanks-eol.txt [13M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/blanks-tabs.txt [2.0M] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-checkstyle-root.txt [14M] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/patch-mvnsite-root.txt [260K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-pathlen.txt [16K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-shellcheck.txt [20K] xml: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/xml.txt [24K] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/results-javadoc-javadoc-root.txt [1.1M] spotbugs: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/branch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/branch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt [0] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-3.3-java8-linux-x86_64/14/artifact/out/branch-spotbugs-hadoop-yarn-project_hadoop-yarn_hadoop-
[jira] [Resolved] (HADOOP-17820) Remove dependency on jdom
[ https://issues.apache.org/jira/browse/HADOOP-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HADOOP-17820. - Resolution: Won't Do > Remove dependency on jdom > - > > Key: HADOOP-17820 > URL: https://issues.apache.org/jira/browse/HADOOP-17820 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Siyao Meng >Assignee: Siyao Meng >Priority: Major > > It doesn't seem that jdom is referenced anywhere in the code base now, yet it > exists in the distribution. > {code} > $ find . -name "*jdom*.jar" > ./hadoop-3.4.0-SNAPSHOT/share/hadoop/tools/lib/jdom-1.1.jar > {code} > There is recently > [CVE-2021-33813|https://github.com/advisories/GHSA-2363-cqg2-863c] issued for > jdom. Let's remove the binary from the dist if not useful. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17821) Update link of Ozone on Hadoop Website
Yi-Sheng Lien created HADOOP-17821: -- Summary: Update link of Ozone on Hadoop Website Key: HADOOP-17821 URL: https://issues.apache.org/jira/browse/HADOOP-17821 Project: Hadoop Common Issue Type: Improvement Reporter: Yi-Sheng Lien Assignee: Yi-Sheng Lien Hi all, as Ozone was spun to TLP, it has individual web site. Now on Modules part of Hadoop [website|https://hadoop.apache.org/], the link of Ozone website is old page. IMHO there is two ways to fix it : 1. update it to new page. 2. move Ozone to Related projects part on Hadoop website Please feel free to give me some feedback, thanks -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/584/ [Jul 29, 2021 3:19:17 AM] (Xiaoqiao He) HDFS-15175. Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog. Contributed by Wan Chang. [Jul 29, 2021 4:57:28 AM] (noreply) HDFS-15936.Solve SocketTimeoutException#sendPacket() does not record SocketTimeout exception. (#2836) [Jul 29, 2021 9:25:39 AM] (noreply) YARN-10841. Fix token reset synchronization for UAM response token. (#3194) [Jul 29, 2021 11:43:40 AM] (Szilard Nemeth) YARN-10628. Add node usage metrics in SLS. Contributed by Vadaga Ananyo Rao [Jul 29, 2021 3:37:40 PM] (Szilard Nemeth) YARN-10663. Add runningApps stats in SLS. Contributed by Vadaga Ananyo Rao [Jul 29, 2021 3:56:14 PM] (noreply) YARN-10869. CS considers only the default maximum-allocation-mb/vcore property as a maximum when it creates dynamic queues (#3225) [Jul 29, 2021 5:15:27 PM] (noreply) YARN-10856. Prevent ATS v2 health check REST API call if the ATS service itself is disabled. (#3236) [Jul 29, 2021 5:50:57 PM] (noreply) HADOOP-17815. Run CI for Centos 7 (#3231) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/207/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org