Steve Loughran created HADOOP-18486:
---------------------------------------
Summary: hadoop-aws tests to take a configurable subdir in the
test bucket
Key: HADOOP-18486
URL: https://issues.apache.org/jira/browse/HADOOP-18486
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3, test
Affects Versions: 3.3.5
Reporter: Steve Loughran
For parallel jenkins runs (now possible with s3guard cut) we need to be able to
run the failsafe test suites either in separate buckets brackets (which doesn't
scale) or in subdirectories of a single bucket. That needs a way to pass in a
base directory for the suites and to disable cleanup of the entire bucket
afterwards. Option pick up is straightforward; we will do it the way we have
done with the others –an auth-keys option which can be overridden on the
command line.
{{S3ATestUtils.createTestPath(Path defVal)}} is already used to create test
paths; it can be extended to pick up a unique process id as well as thread id
system property, and use that for the path it constructs.
another system property/config option is needed to disable root dir tests
(ITestMarkerToolRootOperations, ITestS3AContractRootDir). a config/property
picked up by the S3AContract returning false when probed for
"test.root-tests-enabled" should do most of that.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
