[
https://issues.apache.org/jira/browse/HADOOP-18508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843163#comment-17843163
]
ASF GitHub Bot commented on HADOOP-18508:
-----------------------------------------
steveloughran commented on PR #5081:
URL: https://github.com/apache/hadoop/pull/5081#issuecomment-2092619972
...and I've found out that terasort paths aren't isolated
```
[ERROR] Failures:
[ERROR]
org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort[magic](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A)
[ERROR] Run 1:
ITestTerasortOnS3A.test_120_terasort:289->executeStage:239->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
terasort(s3a://stevel-london/terasort-magic-false/sortin,
s3a://stevel-london/terasort-magic-false/sortout) failed expected:<0> but
was:<1>
[ERROR] Run 2:
ITestTerasortOnS3A.test_120_terasort:289->executeStage:239->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
terasort(s3a://stevel-london/terasort-magic-true/sortin,
s3a://stevel-london/terasort-magic-true/sortout) failed expected:<0> but was:<1>
[INFO]
[ERROR]
ITestTerasortOnS3A.test_130_teravalidate:305->executeStage:239->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
teravalidate(s3a://stevel-london/terasort-directory-false/sortout,
s3a://stevel-london/terasort-directory-false/validate) failed expected:<0> but
was:<1>
[INFO]
[ERROR] Tests run: 141, Failures: 2, Errors: 0, Skipped: 46
```
> support multiple s3a integration test runs on same bucket in parallel
> ---------------------------------------------------------------------
>
> Key: HADOOP-18508
> URL: https://issues.apache.org/jira/browse/HADOOP-18508
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.3.9
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
>
> to have (internal, sorry) jenkins test runs work in parallel, they need to
> share the same bucket so
> # must have a prefix for job id which is passed in to the path used for forks
> # support disabling root tests so they don't stamp on each other
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]