[
https://issues.apache.org/jira/browse/FLINK-26322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504074#comment-17504074
]
Alexander Preuss commented on FLINK-26322:
------------------------------------------
Hi guys, I tested against master with commit 26d7c09b. Great to hear that 3 is
already in progress. For 4 it gets stuck after the restart.
The job is a very simple one, using enableCompactionOnCheckpoint(2) and
env.fromSequence to generate some data
> Test FileSink compaction manually
> ---------------------------------
>
> Key: FLINK-26322
> URL: https://issues.apache.org/jira/browse/FLINK-26322
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Affects Versions: 1.15.0
> Reporter: Yun Gao
> Assignee: Alexander Preuss
> Priority: Blocker
> Labels: release-testing
> Fix For: 1.15.0
>
>
> Documentation of compaction on FileSink:
> [https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/filesystem/#compaction]
> Possible scenarios might include
> # Enable compaction with file-size based compaction strategy.
> # Enable compaction with number-checkpoints based compaction strategy.
> # Enable compaction, stop-with-savepoint and restarted with compaction
> disabled.
> # Disable compaction, stop-with-savepoint and restarted with compaction
> enabled.
> For each scenario, it might need to verify that
> # No repeat and missed records.
> # The resulted files' size exceeds the specified condition.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
