[
https://issues.apache.org/jira/browse/BEAM-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500010#comment-17500010
]
Alexey Romanenko commented on BEAM-14011:
-----------------------------------------
Thanks! I briefly took a look on AWS v1 version and it seems there is not such
issue with multipartCopy.
Also, {{S3FileSystem}} AWS v2 uses a deprecated API for multipart copy now, so
we need to fix it there as well.
> AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters
> ----------------------------------------------------------------------
>
> Key: BEAM-14011
> URL: https://issues.apache.org/jira/browse/BEAM-14011
> Project: Beam
> Issue Type: Bug
> Components: io-java-aws
> Affects Versions: 2.29.0, 2.30.0, 2.31.0, 2.32.0, 2.33.0, 2.34.0, 2.35.0,
> 2.36.0
> Reporter: Stephen Patel
> Assignee: Stephen Patel
> Priority: P2
>
> The following code locations use incorrect parameters:
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L518-L519]
> and
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L539-L540]
> specifies the sourcePath instead of the destinationPath.
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L541]
> specifies destinationPath.getBucket() instead of sourcePath.getBucket()
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L556]
> specifies a constant part number of 1, instead of using the partNumber
> variable.
> Taken together, these issues cause multipart copies to fail due to:
> {noformat}
> software.amazon.awssdk.services.s3.model.NoSuchUploadException: The specified
> upload does not exist. The upload ID may be invalid, or the upload may have
> been aborted or completed.
> {noformat}
> If the object references are fixes, the part number issue causes multipart
> copies to fail due to:
> {noformat}
> software.amazon.awssdk.services.s3.model.S3Exception: The list of parts was
> not in ascending order. Parts must be ordered by part number.
> {noformat}
> Note: I checked the AWS SDK1 S3FileSystem and did not see the same issues.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
