[
https://issues.apache.org/jira/browse/HADOOP-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793306#comment-17793306
]
ASF GitHub Bot commented on HADOOP-18997:
-----------------------------------------
steveloughran commented on PR #6316:
URL: https://github.com/apache/hadoop/pull/6316#issuecomment-1840929387
tested s3express us-west. all the role tests are failing, but not in
createsession; some other issue which I won't address here.
ITestS3ACommitterFactory seems unrelated; the setting of the invalid config
isn't getting passed down. will create a jira there too.
```
[ERROR] Failures:
[ERROR]
ITestS3ACommitterFactory.testEverything:115->testInvalidFileBinding:165
Expected a org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown,
but got the result: :
FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job_202312050493_0007};
taskId=attempt_202312050493_0007_m_000000_0, status=''};
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@2421954a};
outputPath=s3a://stevel--usw2-az1--x-s3/fork-0007/test/testEverything,
workPath=s3a://stevel--usw2-az1--x-s3/fork-0007/test/testEverything/_temporary/1/_temporary/attempt_202312050493_0007_m_000000_0,
algorithmVersion=1, skipCleanup=false, ignoreCleanupFailures=false}
[ERROR] Errors:
[ERROR] ITestAssumeRole.testPartialDelete:696->executePartialDelete:732 »
AccessDenied
[ERROR]
ITestAssumeRole.testPartialDeleteSingleDelete:702->executePartialDelete:732 »
AccessDenied
[ERROR] ITestAssumeRole.testReadOnlyOperations:463 » AccessDenied
s3a://stevel--usw2-a...
[ERROR] ITestAssumeRole.testRestrictedCommitActions:626 » AccessDenied
s3a://stevel--u...
[ERROR] ITestAssumeRole.testRestrictedWriteSubdir:513 » AccessDenied
s3a://stevel--usw...
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testAbortNonexistentDir:234
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testBaseRelativePath:282
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testBulkCommitFiles:602
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testCommitEmptyFile:217->ITestCommitOperations.createCommitAndVerify:346
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testCommitSmallFile:223->ITestCommitOperations.createCommitAndVerify:346
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testCreateAbortEmptyFile:172
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testFailuresInAbortListing:566
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testMarkerFileRename:304
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testRevertCommit:544 »
AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testRevertMissingCommit:556
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testUploadEmptyFile:472
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testUploadSmallFile:503
» AccessDenied
[ERROR]
ITestAssumedRoleCommitOperations>ITestCommitOperations.testWriteNormalStream:581
» AccessDenied
[ERROR]
ITestCustomSigner.testCustomSignerAndInitializer:135->runStoreOperationsAndVerify:155->lambda$runStoreOperationsAndVerify$0:160
» AWSBadRequest
[ERROR]
ITestCustomSigner.testCustomSignerAndInitializer:135->runStoreOperationsAndVerify:155->lambda$runStoreOperationsAndVerify$0:160
» AWSBadRequest
[ERROR]
ITestRestrictedReadAccess.testNoReadAccess:211->checkBasicFileOperations:283 »
AccessDenied
[ERROR]
ITestRoleDelegationInFilesystem>ITestSessionDelegationInFilesystem.testDelegatedFileSystem:406->ITestSessionDelegationInFilesystem.executeDelegatedFSOperations:454
» AccessDenied
[ERROR] ITestPartialRenamesDeletes.testCopyDirFailsToReadOnlyDir:519 »
AccessDenied s3...
[ERROR] ITestPartialRenamesDeletes.testCopyDirFailsToReadOnlyDir:519 »
AccessDenied s3...
[ERROR] ITestPartialRenamesDeletes.testPartialDirDelete:607 » AccessDenied
s3a://steve...
[ERROR] ITestPartialRenamesDeletes.testPartialDirDelete:607 » AccessDenied
s3a://steve...
[ERROR] ITestPartialRenamesDeletes.testPartialEmptyDirDelete:572 »
AccessDenied s3a://...
[ERROR] ITestPartialRenamesDeletes.testPartialEmptyDirDelete:572 »
AccessDenied s3a://...
[ERROR] ITestPartialRenamesDeletes.testRenameDirFailsInDelete:457 »
AccessDenied s3a:/...
[ERROR] ITestPartialRenamesDeletes.testRenameDirFailsInDelete:457 »
AccessDenied s3a:/...
[ERROR] ITestPartialRenamesDeletes.testRenameFileFailsNoWrite:503 »
AccessDenied s3a:/...
[ERROR] ITestPartialRenamesDeletes.testRenameFileFailsNoWrite:503 »
AccessDenied s3a:/...
[ERROR] ITestPartialRenamesDeletes.testRenameParentPathNotWriteable:393 »
AccessDenied
[ERROR] ITestPartialRenamesDeletes.testRenameParentPathNotWriteable:393 »
AccessDenied
[ERROR] ITestPartialRenamesDeletes.testRenamePermissionRequirements:756 »
AccessDenied
[ERROR] ITestPartialRenamesDeletes.testRenamePermissionRequirements:756 »
AccessDenied
[ERROR] ITestPartialRenamesDeletes.testRenameSingleFileFailsInDelete:416 »
AccessDenied
[ERROR] ITestPartialRenamesDeletes.testRenameSingleFileFailsInDelete:416 »
AccessDenied
```
> S3A: add way to turn off CreateSession API
> ------------------------------------------
>
> Key: HADOOP-18997
> URL: https://issues.apache.org/jira/browse/HADOOP-18997
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
>
> add a way to disable the need to use the createsession call, so as to allow
> for
> * simplifying our role test runs
> * benchmarking the performance hit
> * troubleshooting IAM permissions
> this can also be disabled from the sysprop "aws.disableS3ExpressAuth"
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
