Re: Exception in snapshotState suppresses subsequent checkpoints

2021-07-01 Thread tao xiao
eb46c4e516d6ee31ef8eb38e2d4359042 > > Best > Yun Tang > -- > *From:* Matthias Pohl > *Sent:* Thursday, July 1, 2021 16:41 > *To:* tao xiao > *Cc:* Yun Tang ; user ; Roman > Khachatryan > *Subject:* Re: Exception in snapshotState suppresses subsequent > check

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-07-01 Thread Yun Tang
bject: Re: Exception in snapshotState suppresses subsequent checkpoints Hi Tao, it looks like it should work considering that you have a sleep of 1 second before each emission. I'm going to add Roman to this thread. Maybe, he has sees something obvious which I'm missing. Could you run t

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-07-01 Thread Matthias Pohl
Object lock = ctx.getCheckpointLock(); >> >> while (isRunning && numElementsEmitted < Integer.MAX_VALUE) { >> Thread.sleep(1000); >> synchronized (lock) { >> ctx.collect(numElementsEmitted++); >> } >> } >> } >> >> @Override >> public void cancel() {

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-06-30 Thread tao xiao
- > > @Override > public void snapshotState(FunctionSnapshotContext context) throws Exception > { > Preconditions.checkState( > this.checkpointedState != null, > "The " + getClass().getSimpleName() + " has not been properl

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-06-28 Thread tao xiao
tsFunctionT' has ever been > completed. > > Best > Yun Tang > -- > *From:* tao xiao > *Sent:* Saturday, June 26, 2021 16:40 > *To:* user > *Subject:* Re: Exception in snapshotState suppresses subseq

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-06-27 Thread Yun Tang
ther your tasks containing 'FromElementsFunctionT' has ever been completed. Best Yun Tang From: tao xiao Sent: Saturday, June 26, 2021 16:40 To: user Subject: Re: Exception in snapshotState suppresses subsequent checkpoints Btw here is the checkpoint relat

Exception in snapshotState suppresses subsequent checkpoints

2021-06-26 Thread tao xiao
Hi team, I run a simple 1.12.1 Flink job in IDE with TolerableCheckpointFailureNumber set where I throw an exception in source function snapshotState intentionally to verify how Flink behaves. What I find is the first checkpoint throws the exception and eventually time out while the main flow cont

Re: Exception in snapshotState suppresses subsequent checkpoints

2021-06-26 Thread tao xiao
Btw here is the checkpoint related log [2021-06-26 16:08:52,352] INFO Triggering checkpoint 1 (type=CHECKPOINT) @ 1624694932345 for job afde4a82f41e8284cb0bfff20497a5cc. (org.apache.flink.runtime.checkpoint.CheckpointCoordinator) [2021-06-26 16:08:52,372] INFO Could not complete snapshot 1 for ope