Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.fs.TestTrash hadoop.io.compress.snappy.TestSnappyCompressorDecompressor hadoop.fs.TestFileUtil hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.lib.input.TestLineRecordReader hadoop.mapred.TestLineRecordReader hadoop.tools.TestDistCpSystem hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.solver.impl.TestLpSolver hadoop.resourceestimator.service.TestResourceEstimatorService cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-compile-javac-root.txt [476K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-checkstyle-root.txt [14M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-mvnsite-root.txt [556K] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/diff-patch-shellcheck.txt [72K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-javadoc-root.txt [40K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [224K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [428K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [36K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt [20K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [120K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [104K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-tools_hadoop-distcp.txt [24K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt [20K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/606/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt [28K] https
[jira] [Created] (HDFS-16512) Improve oiv tool to parse fsimage file in parallel with XML format
Hongbing Wang created HDFS-16512: Summary: Improve oiv tool to parse fsimage file in parallel with XML format Key: HDFS-16512 URL: https://issues.apache.org/jira/browse/HDFS-16512 Project: Hadoop HDFS Issue Type: Improvement Reporter: Hongbing Wang Assignee: Hongbing Wang -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/ No changes -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor cc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-compile-cc-root.txt [96K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-compile-javac-root.txt [340K] blanks: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/blanks-eol.txt [13M] https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/blanks-tabs.txt [2.0M] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-checkstyle-root.txt [14M] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-pathlen.txt [16K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-pylint.txt [20K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-shellcheck.txt [28K] xml: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/xml.txt [24K] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/results-javadoc-javadoc-root.txt [404K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/814/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-router.txt [20K] Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16513) [SBN read] Observer Namenode does not trigger the edits rolling of active Namenode
tomscut created HDFS-16513: -- Summary: [SBN read] Observer Namenode does not trigger the edits rolling of active Namenode Key: HDFS-16513 URL: https://issues.apache.org/jira/browse/HDFS-16513 Project: Hadoop HDFS Issue Type: Improvement Reporter: tomscut Assignee: tomscut To avoid frequent edtis rolling, we should disable OBN from triggering the edits rolling of active Namenode. It is sufficient to retain only the triggering of SNN and the auto rolling of ANN. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example mr applications and check the result - Pi & wordcount. * Check the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc. * Check git and JIRA using `git_jira_fix_version_check.py` and output as follows, some of them are historic issues. And HADOOP-17592 is misspelled in the git message which is declared at HADOOP-17592 comments. IMO, both of them are not blocking this release progress. So give my +1. Thanks Masatake Iwasaki for your work. - He Xiaoqiao hexiaoqiao-ubuntu:~/Source/hadoop/dev-support/git-jira-validation$ > ./venv/bin/python git_jira_fix_version_check.py > JIRA Project Name (e.g HADOOP / OZONE etc): HADOOP > First commit hash to start excluding commits from history: > a17793534c04e0d6a77e3946cc15862c3d293a67 > Fix Version: 3.2.3 > Jira server url (default: https://issues.apache.org/jira): > Path of project's working dir with release branch checked-in: > /home/hexiaoqiao/Source/hadoop > > Check git status output and verify expected branch > > HEAD detached at release-3.2.3-RC1 > Untracked files: > (use "git add ..." to include in what will be committed) > dev-support/git-jira-validation/venv/ > hadoop-common-project/hadoop-common/src/site/markdown/release/3.2.2/ > CHANGELOG.3.2.2.md > hadoop-common-project/hadoop-common/src/site/markdown/release/3.2.2/ > RELEASENOTES.3.2.2.md > hadoop-common-project/hadoop-common/src/site/markdown/release/README.md > hadoop-common-project/hadoop-common/src/site/markdown/release/index.md > hadoop-hdfs-project/hadoop-hdfs-rbf/src/site/resources/configuration.xsl > > hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/ > > nothing added to commit but untracked files present (use "git add" to > track) > > > Jira/Git commit message diff starting: > ## > WARN: Jira not found. Commit: 0b91f27a3240cb5ed68d27915251e98f1043b4fa > updated contents for 3.2.3 release. > WARN: Jira not found. Commit: 182167a9fb3ba76c3a48d3d2205787301a00aa13 > Preparing for 3.2.3 release. > WARN: Jira not found. Commit: 78c5fdd90dd321b77a049a9af95a2bd162ea1f22 Fix > potential heap buffer overflow in hdfs.c. Contributed by Igor Chervatyuk. > Jira not present with version: 3.2.3. Commit: > 1f9a315625d3d1bcc8950b56eddc6330297c9bd3 YARN-10337. Amendment to fix > import as in HADOOP-17100 > WARN: Jira not found. Commit: b8f0be3299df9f6d31a7ae81342a735ad4402a5c > Bump bower from 1.7.7 to 1.8.8 (#1683) > Commit seems reverted. Commit: d92af850456bd80f61741e41ee9bc3329cfc00cd > Revert "HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp > (#3042)" > WARN: Jira not found. Commit: f5568e15d0d6fdf9593ee869485aa6471b889d52 Fix > container-executor > Jira not present with version: 3.2.3. Commit: > 20a4cb0c67b413e7b9bc2b3213b5b592bfaa99d5 HDFS-16033 Fix issue of the > StatisticsDataReferenceCleaner cleanUp (#3042) > Commit seems reverted. Commit: 1eef5c2861c145250d2675946cf1d2c293c0cef8 > Revert "HADOOP-17563. Update Bouncy Castle to 1.68. (#2740)" (#3055) > Commit seems reverted. Commit: ef197db8b909921e7fba785e90b78780bfa5a580 > Revert "HADOOP-17661. mvn versions:set fails to parse pom.xml. (#2952)" > Commit seems reverted. Commit: 93517ba9bca68aa987ac1ad5ce0923444eb11c87 > Revert "HDFS-15900. RBF: empty blockpool id on dfsrouter caused by > UNAVAILABLE NameNode. (#2787)" > Jira not present with version: 3.2.3. Commit: > 35855007f6e18298c849f7830c0d6550ffba9e9a HADOOP-17952. Fix the wrong CIDR > range example in Proxy User documentation. (#2780) > Jira not present with version: 3.2.3. Commit: > 7a8542b833172ba4c78c8a504d2b8b401e18b6f2 HADOOP-17563. Update Bouncy Castle > to 1.68. (#2740) > Jira not present with version: 3.2.3. Commit: > 86b387622a65c94bdad49785549334821e75cfaa [MAPREDUCE-7234] > ClientHSSecurityInfo class is in wrong META-INF file. Contributed by Eric > Badger. > WARN: Jira not found. Commit: 2117ab6b7125bfcbdae907015001a7599e2f0c4c > RN-10500. TestDelegationTokenRenewer fails intermittently. (#2619) > Contributed by Masatake Iwasaki > Found first commit hash after which git history is redundant. commit: > a17793534c04e0d6a77e3946cc15862c3d293a67 > Exiting successfully > Jira/Git commit message diff completed: > ## > > Any resolved Jira with fixVersion 3.2.3 but corresponding commit not > present > Starting diff: ## > HADOOP-17592 is marked resolved with fixVersion 3.2.3 but no corresponding > commit found > Completed diff: ## > On Sun, Mar 20, 2022 at 1:32 PM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Hi all, > > Here's Hadoop 3.2.3 rele
