Attila Doroszlai created HADOOP-19133:
-----------------------------------------
Summary: "No test bucket" error in ITestS3AContractVectoredRead if
provided via CLI property
Key: HADOOP-19133
URL: https://issues.apache.org/jira/browse/HADOOP-19133
Project: Hadoop Common
Issue Type: Bug
Components: test, tools
Reporter: Attila Doroszlai
ITestS3AContractVectoredRead fails with {{NullPointerException: No test
bucket}} if test bucket is defined as {{-Dtest.fs.s3a.name=...}} via CLI , not
in {{auth-keys.xml}}. The same setup works for other S3A contract tests.
Tested on 3.3.6.
{code:title=src/test/resources/auth-keys.xml}
<configuration>
<property>
<name>fs.s3a.endpoint</name>
<value>${test.fs.s3a.endpoint}</value>
</property>
<property>
<name>fs.contract.test.fs.s3a</name>
<value>${test.fs.s3a.name}</value>
</property>
</configuration>
{code}
{code}
export AWS_ACCESS_KEY_ID='<redacted>'
export AWS_SECRET_KEY='<redacted>'
mvn -Dtest=ITestS3AContractVectoredRead -Dtest.fs.s3a.name="s3a://mybucket"
-Dtest.fs.s3a.endpoint="http://localhost:9878/"; clean test
{code}
{code:title=test results}
Tests run: 46, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 7.879 s <<<
FAILURE! - in org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead
testMinSeekAndMaxSizeDefaultValues[Buffer type :
direct](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 1.95 s <<< ERROR!
java.lang.NullPointerException: No test bucket
at org.apache.hadoop.util.Preconditions.checkNotNull(Preconditions.java:88)
at
org.apache.hadoop.fs.s3a.S3ATestUtils.getTestBucketName(S3ATestUtils.java:714)
at
org.apache.hadoop.fs.s3a.S3ATestUtils.removeBaseAndBucketOverrides(S3ATestUtils.java:775)
at
org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead.testMinSeekAndMaxSizeDefaultValues(ITestS3AContractVectoredRead.java:104)
...
testMinSeekAndMaxSizeConfigsPropagation[Buffer type :
direct](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.176 s <<< ERROR!
testMultiVectoredReadStatsCollection[Buffer type :
direct](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.179 s <<< ERROR!
testNormalReadVsVectoredReadStatsCollection[Buffer type :
direct](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.155 s <<< ERROR!
testMinSeekAndMaxSizeDefaultValues[Buffer type :
array](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.116 s <<< ERROR!
testMinSeekAndMaxSizeConfigsPropagation[Buffer type :
array](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.102 s <<< ERROR!
testMultiVectoredReadStatsCollection[Buffer type :
array](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.105 s <<< ERROR!
testNormalReadVsVectoredReadStatsCollection[Buffer type :
array](org.apache.hadoop.fs.contract.s3a.ITestS3AContractVectoredRead) Time
elapsed: 0.107 s <<< ERROR!
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
