TestServiceAM
I can see the reported failure of TestServiceAM in some "Apache Hadoop qbt Report:
branch-3.2+JDK8 on Linux/x86_64".
3.3.0 and above might be fixed by YARN-8867 which added guard using
GenericTestUtils#waitFor for stabilizing the
testContainersReleasedWhenPreLaunchFails.
YARN 8867 did not modified other code under hadoop-yarn-services.
If it is the case, TestServiceAM can be tagged as flaky in branch-3.2.
On 2022/07/20 14:21, Masatake Iwasaki wrote:
Thanks for testing the RC0, Chris.
The following are new test failures for me on 3.2.4:
* TestAMRMProxy
* TestFsck
* TestSLSStreamAMSynth
* TestServiceAM
I could not reproduce the test failures on my local.
For TestFsck, if the failed test case is testFsckListCorruptSnapshotFiles,
cherry-picking HDFS-15038 (fixing only test code) could be the fix.
The failure of TestSLSStreamAMSynth looks frequently reported by
"Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64".
It could be tagged as known flaky test.
On 2022/07/20 9:15, Chris Nauroth wrote:
-0 (binding)
* Verified all checksums.
* Verified all signatures.
* Built from source, including native code on Linux.
* mvn clean package -Pnative -Psrc -Drequire.openssl -Drequire.snappy
-Drequire.zstd -DskipTests
* Tests mostly passed, but see below.
* mvn --fail-never clean test -Pnative -Dparallel-tests
-Drequire.snappy -Drequire.zstd -Drequire.openssl
-Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8
The following are new test failures for me on 3.2.4:
* TestAMRMProxy
* TestFsck
* TestSLSStreamAMSynth
* TestServiceAM
The following tests also failed, but they also fail for me on 3.2.3, so
they aren't likely to be related to this release candidate:
* TestCapacitySchedulerNodeLabelUpdate
* TestFrameworkUploader
* TestSLSGenericSynth
* TestSLSRunner
* test_libhdfs_threaded_hdfspp_test_shim_static
I'm not voting a full -1, because I haven't done any root cause analysis on
these new test failures. I don't know if it's a quirk to my environment,
though I'm using the start-build-env.sh Docker container, so any build
dependencies should be consistent. I'd be comfortable moving ahead if
others are seeing these tests pass.
Chris Nauroth
On Thu, Jul 14, 2022 at 7:57 AM Masatake Iwasaki <iwasak...@oss.nttdata.com>
wrote:
+1 from myself.
* skimmed the contents of site documentation.
* built the source tarball on Rocky Linux 8 (x86_64) by OpenJDK 8 with
`-Pnative`.
* launched pseudo distributed cluster including kms and httpfs with
Kerberos and SSL enabled.
* created encryption zone, put and read files via httpfs.
* ran example MR wordcount over encryption zone.
* launched 3-node docker cluster with NN-HA and RM-HA enabled and ran some
example MR jobs.
* built HBase 2.4.11, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.4 RC0
on CentOS 7 (x86_64) by using Bigtop branch-3.1 and ran smoke-tests.
https://github.com/apache/bigtop/pull/942
* Hive needs updating exclusion rule to address HADOOP-18088 (migration
to reload4j).
* built Spark 3.3.0 against Hadoop 3.2.4 RC0 using the staging repository::
<repository>
<id>staged</id>
<name>staged-releases</name>
<url>
https://repository.apache.org/content/repositories/orgapachehadoop-1354
</url>
<releases>
<enabled>true</enabled>
</releases>
<snapshots>
<enabled>true</enabled>
</snapshots>
</repository>
Thanks,
Masatake Iwasaki
On 2022/07/13 1:14, Masatake Iwasaki wrote:
Hi all,
Here's Hadoop 3.2.4 release candidate #0:
The RC is available at:
https://home.apache.org/~iwasakims/hadoop-3.2.4-RC0/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.2.4-RC0
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1354
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
Please evaluate the RC and vote.
The vote will be open for (at least) 5 days.
Thanks,
Masatake Iwasaki
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
