[
https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287451#comment-17287451
]
Jiangjie Qin commented on FLINK-21133:
--------------------------------------
[~pnowojski] I might get a little confused about what options we eventually
want to provide to the users. It would probably help to clarify that first. I
am thinking of the following cases:
*Cancel* - Stop the job without any data integrity guarantee. The job will not
be able to resume, the output from the job is not guaranteed to be consistent.
It is similar to a force quit.
*Stop* - Stop the job elegantly without the intention to resume the job. This
is an orderly shutdown without a savepoint. It lets all the records in the
pipeline get processed. {{MAX_WATERMARK}} will be emitted to ensure the final
result gets written to the output. {{EndOfPartition}} will also be emitted as
if all the records have been processed.
*Stop with Savepoint (Suspend / Pause)* - Stop the job elegantly with the
intention to resume the job. This is also an orderly shutdown but with a
savepoint taken. It lets all the records in the pipeline get processed. No
{{MAX_WATERMARK}} or {{EndOfPartition}} will be emitted because the job is
supposed to be resumed later.
> FLIP-27 Source does not work with synchronous savepoint
> -------------------------------------------------------
>
> Key: FLINK-21133
> URL: https://issues.apache.org/jira/browse/FLINK-21133
> Project: Flink
> Issue Type: Bug
> Components: API / Core, API / DataStream, Runtime / Checkpointing
> Affects Versions: 1.11.3, 1.12.1
> Reporter: Kezhu Wang
> Priority: Critical
> Fix For: 1.11.4, 1.13.0, 1.12.3
>
>
> I have pushed branch
> [synchronous-savepoint-conflict-with-bounded-end-input-case|https://github.com/kezhuw/flink/commits/synchronous-savepoint-conflict-with-bounded-end-input-case]
> in my repository. {{SavepointITCase.testStopSavepointWithFlip27Source}}
> failed due to timeout.
> See also FLINK-21132 and
> [apache/iceberg#2033|https://github.com/apache/iceberg/issues/2033]..
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
