[
https://issues.apache.org/jira/browse/FLINK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Lu updated FLINK-40083:
-----------------------------
Description:
The S3 filesystem tests use SeaweedFS as their S3 backend (FLINK-39499). Two
improvements:
# Launch the container with "weed mini", which pre-creates the bucket via
"-bucket" and reports readiness only after all components are up — removing the
client-side bucket creation, the startup-503 retry workaround, and the /healthz
poll from both SeaweedFsTestContainer and common_s3_seaweedfs.sh.
# Bump the pinned image chrislusf/seaweedfs 4.34 → 4.38. 4.38 answers S3
directory-path probes the way AWS does
(https://github.com/seaweedfs/seaweedfs/pull/10225) so Flink
savepoints/checkpoints restore correctly against SeaweedFS, and adds multipart
/ truncated-PUT robustness fixes.
PR: [https://github.com/apache/flink/pull/28560]
was:
The S3 filesystem tests use SeaweedFS as their S3 backend (FLINK-39499). Two
improvements:
# Launch the container with "weed mini", which pre-creates the bucket via
"-bucket" and reports readiness only after all components are up — removing the
client-side bucket creation, the startup-503 retry workaround, and the /healthz
poll from both SeaweedFsTestContainer and common_s3_seaweedfs.sh.
# Bump the pinned image chrislusf/seaweedfs 4.34 → 4.38. 4.38 answers S3
directory-path probes the way AWS does [(SeaweedFS #10225)|http://example.com/]
so Flink savepoints/checkpoints restore correctly against SeaweedFS, and adds
multipart / truncated-PUT robustness fixes.
PR: [https://github.com/apache/flink/pull/28560]
> Launch the SeaweedFS S3 test backend via weed mini and bump the image to 4.38
> -----------------------------------------------------------------------------
>
> Key: FLINK-40083
> URL: https://issues.apache.org/jira/browse/FLINK-40083
> Project: Flink
> Issue Type: Improvement
> Components: Tests
> Reporter: Chris Lu
> Priority: Major
>
> The S3 filesystem tests use SeaweedFS as their S3 backend (FLINK-39499). Two
> improvements:
> # Launch the container with "weed mini", which pre-creates the bucket via
> "-bucket" and reports readiness only after all components are up — removing
> the client-side bucket creation, the startup-503 retry workaround, and the
> /healthz poll from both SeaweedFsTestContainer and common_s3_seaweedfs.sh.
> # Bump the pinned image chrislusf/seaweedfs 4.34 → 4.38. 4.38 answers S3
> directory-path probes the way AWS does
> (https://github.com/seaweedfs/seaweedfs/pull/10225) so Flink
> savepoints/checkpoints restore correctly against SeaweedFS, and adds
> multipart / truncated-PUT robustness fixes.
> PR: [https://github.com/apache/flink/pull/28560]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
