[
https://issues.apache.org/jira/browse/HADOOP-19241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869600#comment-17869600
]
Steve Loughran commented on HADOOP-19241:
-----------------------------------------
we have had problems with the aws sdk logging, though AFAIK it was related to
being impossible to configure the logging, rather than this. there have been
improvements, but no guarantee it is fixed.
[~ashutoshraina] can you check out and buiild hadoop trunk or branch-3.4
branches, or just drop in the latest SDK, and see how that works?
we are doing a new 3.4.1 release soon and it'd be good to know if the current
sdk works for you
> NoSuchMethodError in aws sdk third party logger in hadoop aws 3.4
> -----------------------------------------------------------------
>
> Key: HADOOP-19241
> URL: https://issues.apache.org/jira/browse/HADOOP-19241
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: ashutoshraina
> Priority: Major
>
> {code:java}
> "localizedMessage": "java.lang.NoSuchMethodError:
> 'software.amazon.awssdk.thirdparty.org.slf4j.Logger
> software.amazon.awssdk.utils.Logger.logger()'",
> "message": "java.lang.NoSuchMethodError:
> 'software.amazon.awssdk.thirdparty.org.slf4j.Logger
> software.amazon.awssdk.utils.Logger.logger()'",
> "name": "com.google.common.util.concurrent.ExecutionError",
> "cause": {
> "commonElementCount": 1,
> "localizedMessage": "'software.amazon.awssdk.thirdparty.org.slf4j.Logger
> software.amazon.awssdk.utils.Logger.logger()'",
> "message": "'software.amazon.awssdk.thirdparty.org.slf4j.Logger
> software.amazon.awssdk.utils.Logger.logger()'",
> "name": "java.lang.NoSuchMethodError",
> "extendedStackTrace": [
> {
> "class":
> "software.amazon.awssdk.transfer.s3.internal.GenericS3TransferManager",
> "method": "close",
> "file": "GenericS3TransferManager.java",
> "line": 393,
> "exact": false,
> "location": "bundle-2.23.19.jar",
> "version": "?"
> },
> {
> "class": "org.apache.hadoop.fs.s3a.S3AUtils",
> "method": "closeAutocloseables",
> "file": "S3AUtils.java",
> "line": 1553,
> "exact": false,
> "location": "hadoop-aws-3.4.0.jar",
> "version": "?"
> },
> {
> "class": "org.apache.hadoop.fs.s3a.S3AFileSystem",
> "method": "stopAllServices",
> "file": "S3AFileSystem.java",
> "line": 4358,
> "exact": false,
> "location": "hadoop-aws-3.4.0.jar",
> "version": "?"
> },
> {
> "class": "org.apache.hadoop.fs.s3a.S3AFileSystem",
> "method": "initialize",
> "file": "S3AFileSystem.java",
> "line": 758,
> "exact": false,
> "location": "hadoop-aws-3.4.0.jar",
> "version": "?"
> },
> {
> "class": "org.apache.hadoop.fs.FileSystem",
> "method": "createFileSystem",
> "file": "FileSystem.java",
> "line": 3601,
> "exact": false,
> "location": "hadoop-common-3.4.0.jar",
> "version": "?"
> },
> {
> "class": "org.apache.hadoop.fs.FileSystem",
> "method": "get",
> "file": "FileSystem.java",
> "line": 552,
> "exact": false,
> "location": "hadoop-common-3.4.0.jar",
> "version": "?"
> }, {code}
>
> This appears to be related to how shading works in the aws bundle sdk.
> Hadoop Version : hadoop-aws-3.4.0
> AWS-SDK-Bundle - 2.23.19
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
