For someone having similar issue.
When I tested the RC3, ResourceManager failed to start due to following
exception.::
2021-06-07 10:50:54,715 ERROR
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting
ResourceManager
java.lang.IllegalAccessError: tried to access class
org.bouncycastle.asn1.DEROutputStream from class org.bouncycastle.cert.CertUtils
at org.bouncycastle.cert.CertUtils.generateSig(Unknown Source)
at org.bouncycastle.cert.CertUtils.generateFullCert(Unknown Source)
at org.bouncycastle.cert.X509v3CertificateBuilder.build(Unknown
Source)
at
org.apache.hadoop.yarn.server.webproxy.ProxyCA.createCert(ProxyCA.java:180)
...
The cause turned out to be my local environment.
When I was working on HADOOP-17609, in order to try SM4 feature,
I installed bcprov-ext-jdk15on-168.jar to $JAVA_HOME/jre/lib/ext
and added the line
"security.provider.10=org.bouncycastle.jce.provider.BouncyCastleProvider"
to $JAVA_HOME/jre/lib/security/java.security
based on the comment on HDFS-15098 [1] (and fotgot doing so).
Removing the bcprov-ext-jdk15on-168.jar from $JAVA_HOME/jre/lib/ext fixed the
issue.
[1]
https://issues.apache.org/jira/browse/HDFS-15098?focusedCommentId=17112893&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17112893
Masatake Iwasaki
On 2021/06/07 18:04, Masatake Iwasaki wrote:
I found that the top page of site documentation (index.html on the top
directory)
has the same contents of 3.0.0 (https://hadoop.apache.org/docs/r3.0.0/).
While I think it is not worth for sinking the RC3,
you can update the page based on the one for 3.3.0
(http://hadoop.apache.org/docs/r3.3.0/)
if you need to cut RC4.
Thanks,
Masatake Iwasaki
On 2021/06/01 19:29, Wei-Chiu Chuang wrote:
Hi community,
This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved [1] again.
There are 2 additional issues resolved for RC3:
* Revert "MAPREDUCE-7303. Fix TestJobResourceUploader failures after
HADOOP-16878
* Revert "HADOOP-16878. FileUtil.copy() to throw IOException if the source
and destination are the same
There are 4 issues resolved for RC2:
* HADOOP-17666. Update LICENSE for 3.3.1
* MAPREDUCE-7348. TestFrameworkUploader#testNativeIO fails. (#3053)
* Revert "HADOOP-17563. Update Bouncy Castle to 1.68. (#2740)" (#3055)
* HADOOP-17739. Use hadoop-thirdparty 1.1.1. (#3064)
The Hadoop-thirdparty 1.1.1, as previously mentioned, contains two extra
fixes compared to hadoop-thirdparty 1.1.0:
* HADOOP-17707. Remove jaeger document from site index.
* HADOOP-17730. Add back error_prone
*RC tag is release-3.3.1-RC3
https://github.com/apache/hadoop/releases/tag/release-3.3.1-RC3
*The RC3 artifacts are at*:
https://home.apache.org/~weichiu/hadoop-3.3.1-RC3/
ARM artifacts: https://home.apache.org/~weichiu/hadoop-3.3.1-RC3-arm/
*The maven artifacts are hosted here:*
https://repository.apache.org/content/repositories/orgapachehadoop-1320/
*My public key is available here:*
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Things I've verified:
* all blocker issues targeting 3.3.1 have been resolved.
* stable/evolving API changes between 3.3.0 and 3.3.1 are compatible.
* LICENSE and NOTICE files checked
* RELEASENOTES and CHANGELOG
* rat check passed.
* Built HBase master branch on top of Hadoop 3.3.1 RC2, ran unit tests.
* Built Ozone master on top fo Hadoop 3.3.1 RC2, ran unit tests.
* Extra: built 50 other open source projects on top of Hadoop 3.3.1 RC2.
Had to patch some of them due to commons-lang migration (Hadoop 3.2.0) and
dependency divergence. Issues are being identified but so far nothing
blocker for Hadoop itself.
Please try the release and vote. The vote will run for 5 days.
My +1 to start,
[1] https://issues.apache.org/jira/issues/?filter=12350491
[2]
https://github.com/apache/hadoop/compare/release-3.3.1-RC1...release-3.3.1-RC3
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
