Re: Manual savepoint trigger

2018-10-21 Thread vino yang
Hi Anil, When we trigger a savepoint, the JobManager's CheckpointCoordinator will send an akka message for triggering to all source tasks, which will generate a barrier for the savepoint (checkpoint). I don't know if this explanation is clear enough. Thanks, vino. Anil 于2018年10月22日周一 下午2:21写道:

Re: Manual savepoint trigger

2018-10-21 Thread Anil
I think I didn't make myself clear. Sorry. What I want to know is, when we trigger the savepoint, which checkpoint barrier will it consider to trigger the savepoint. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Manual savepoint trigger

2018-10-21 Thread vino yang
Hi Anil, When you manually trigger a savepoint, it is clear that it will wait for the savepoint to complete. Of course, the behavior of savepoint is consistent with checkpoint. Thanks, vino. Anil 于2018年10月22日周一 下午1:16写道: > A checkpoint is completed when the nth the checkpoint barrier crosses t

Manual savepoint trigger

2018-10-21 Thread Anil
A checkpoint is completed when the nth the checkpoint barrier crosses the last operator. When we trigger a savepoint manually, which checkpoint barrier is considered. Is it the next checkpoint barrier(next relative to the last barrier that was considered to create the last checkpoint or savepoint

Re: JDBCAppendTableSink Metric

2018-10-21 Thread Anil
Thanks Hequn. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink fails continuously: Couldn't retrieve the JobExecutionResult from the JobManager.

2018-10-21 Thread vino yang
Hi Marke, Are you expecting your job to quickly return the results of the stream calculation? If it is running for a long time, you can run it in detached mode when you submit the job[1]. It will not cause your client to be blocked and stay connected to the Flink JobManager. Thanks, vino. [1]: h

Re: Cancel with savepoint on yarn-cluster mode can't retrieve savepointDir.

2018-10-21 Thread vino yang
Hi Shu Li, Paul is right, the issue has been fixed. Please upgrade it to the fixed specific version. Thanks, vino. Paul Lam 于2018年10月19日周五 下午2:35写道: > Hi, > > Please see https://issues.apache.org/jira/browse/FLINK-10309. > > Best, > Paul Lam > > 在 2018年10月19日,14:32,郑舒力 写道: > > Hi community. >

Re: ProgramDescription interface

2018-10-21 Thread vino yang
Hi Flavio, Ping Chesnay and Gary for you. Thanks, vino. Flavio Pompermaier 于2018年10月19日周五 下午11:01写道: > Hi to all, > is there any better way to get the list of required parameters by a Flink > job other than implementing ProgramDescription interface and implementing a > long (and somehow struct

Clean shutdown of streaming job

2018-10-21 Thread Ning Shi
I'm implementing a streaming job that consumes events from Kafka and writes results to Cassandra. The writes to Cassandra are not idempotent. In preparation for planned maintenance events like Flink version upgrade or job update, I'd like to be able to shutdown the job cleanly. I understand that c

Re: Flink Job state debug

2018-10-21 Thread jia yichao
Hi Hequn, That is what I want, thank you for your help. Best, yichao > 在 2018年10月20日,上午9:30,Hequn Cheng 写道: > > Hi yichao, > > There is a checkpointing IT test here[1]. You can run it locally and set > breakpoints to debug. > Furthermore, you can search other checkpointing test case