Re: [EXTERNAL] Re: Inconsistent checkpoint durations vs state size

2020-06-11 Thread Slotterback, Chris
and write time. From: Congxian Qiu Date: Friday, June 5, 2020 at 10:42 PM To: Arvid Heise Cc: "Slotterback, Chris" , "user@flink.apache.org" Subject: Re: [EXTERNAL] Re: Inconsistent checkpoint durations vs state size Hi Chris From the given exception, seems there is so

Re: [EXTERNAL] Re: Inconsistent checkpoint durations vs state size

2020-06-05 Thread Congxian Qiu
nt times fell drastically, >> but with 1 slot per tm our parallelism had to be dropped and our consumer >> lag was growing. >> >> >> >> >> >> >> >> *From: *Congxian Qiu >> *Date: *Friday, May 29, 2020 at 10:59 PM >> *To: *&qu

Re: [EXTERNAL] Re: Inconsistent checkpoint durations vs state size

2020-06-05 Thread Arvid Heise
10:59 PM > *To: *"Slotterback, Chris" > *Cc: *"user@flink.apache.org" > *Subject: *[EXTERNAL] Re: Inconsistent checkpoint durations vs state size > > > > Hi > > From the given picture, > > 1. there were some checkpoint failed(but not because of

Re: Inconsistent checkpoint durations vs state size

2020-05-29 Thread Congxian Qiu
Hi >From the given picture, 1. there were some checkpoint failed(but not because of timeout), could you please check why these checkpoint would fail? 2. The checkpoint data size is the delta size for current checkpoint[1], assume you using incremental checkpoint 3. In fig1 the checkpoint size is ~3