Matthias Pohl created FLINK-26087:
-------------------------------------
Summary: S3 filesystem tests never run in AzureCI
Key: FLINK-26087
URL: https://issues.apache.org/jira/browse/FLINK-26087
Project: Flink
Issue Type: Bug
Components: Connectors / FileSystem
Affects Versions: 1.14.3, 1.13.5, 1.15.0
Reporter: Matthias Pohl
When looking into FLINK-26015 I noticed that the
{{FileSystemBehaviorTestSuite}} doesn't run because of missing S3 credentials.
I checked it only for the {{HadoopS3FileSystemBehaviorITCase}} on {{master}} in
[this
build|https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=31212&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d],
though:
{code}
2022-02-11T07:35:43.3424031Z Feb 11 07:35:43 [INFO] Running
org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterExceptionITCase
2022-02-11T07:35:43.3574806Z Feb 11 07:35:43 [INFO] Running
org.apache.flink.fs.s3hadoop.HadoopS3FileSystemBehaviorITCase
2022-02-11T07:35:43.9597611Z Feb 11 07:35:43 [INFO] Tests run: 0, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.604 s - in
org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterExceptionITCase
2022-02-11T07:35:43.9818566Z Feb 11 07:35:43 [INFO] Tests run: 0, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.612 s - in
org.apache.flink.fs.s3hadoop.HadoopS3FileSystemBehaviorITCase
2022-02-11T07:35:44.6487150Z Feb 11 07:35:44 [ERROR] Picked up
JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
2022-02-11T07:35:44.6953455Z Feb 11 07:35:44 [ERROR] Picked up
JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
2022-02-11T07:35:45.0832407Z Feb 11 07:35:45 [INFO] Running
org.apache.flink.fs.s3hadoop.HadoopS3FileSystemITCase
2022-02-11T07:35:45.1279447Z Feb 11 07:35:45 [INFO] Running
org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterITCase
2022-02-11T07:35:45.7356037Z Feb 11 07:35:45 [INFO] Tests run: 0, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.636 s - in
org.apache.flink.fs.s3hadoop.HadoopS3FileSystemITCase
2022-02-11T07:35:45.8154233Z Feb 11 07:35:45 [INFO] Tests run: 0, Failures: 0,
Errors: 0, Skipped: 0, Time elapsed: 0.677 s - in
org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterITCase
2022-02-11T07:35:46.1720757Z Feb 11 07:35:46 [INFO]
2022-02-11T07:35:46.1721277Z Feb 11 07:35:46 [INFO] Results:
2022-02-11T07:35:46.1721728Z Feb 11 07:35:46 [INFO]
2022-02-11T07:35:46.1722528Z Feb 11 07:35:46 [INFO] Tests run: 0, Failures: 0,
Errors: 0, Skipped: 0
{code}
I'd assume that this holds true for other test where
{{S3TestCredentials.assumeCredentialsAvailable()}} is used. A
{{MinioTestContainer}} was introduced as part of FLINK-26015 that could be
utilized to work around this issue.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
