Re: number of files in checkpoint directory grows endlessly

>> >> rocksdb.merge.operatorMerge By >> TTLrocksdb.num.data.blocksrocksdb.num.entriesrocksdb.prefix.extractor.namenullptrocksdb.property.collectors[]rocksdb.raw.key.sizeArocksdb.r

Re: number of files in checkpoint directory grows endlessly

ndet: Donnerstag, 6. Dezember 2018 12:07 > An: Winterstein, Bernd > Cc: Yun Tang; Kostas Kloudas; user; Stefan Richter; Till Rohrmann; Stephan > Ewen > Betreff: Re: number of files in checkpoint directory grows endlessly > > Hi Bernd, > > Thanks for sharing the code. >

Re: number of files in checkpoint directory grows endlessly

2018 15:25 An: Winterstein, Bernd Cc: Yun Tang; Kostas Kloudas; user; Stefan Richter; Till Rohrmann; step...@data-artisans.com<mailto:step...@data-artisans.com> Betreff: Re: number of files in checkpoint directory grows endlessly Hi Bernd, Thanks for sharing the code. Could you try the

Re: number of files in checkpoint directory grows endlessly

ndet: Mittwoch, 5. Dezember 2018 15:25 > An: Winterstein, Bernd > Cc: Yun Tang; Kostas Kloudas; user; Stefan Richter; Till Rohrmann; > step...@data-artisans.com > Betreff: Re: number of files in checkpoint directory grows endlessly > > Hi Bernd, > > Thanks for sharing the code

Re: number of files in checkpoint directory grows endlessly

> Gesendet: Dienstag, 4. Dezember 2018 13:55 > An: Winterstein, Bernd; and...@data-artisans.com > Cc: k.klou...@data-artisans.com; user@flink.apache.org; > s.rich...@data-artisans.com; t...@data-artisans.com; step...@data-artisans.com > Betreff: Re: number of files in checkpoint dir

Re: number of files in checkpoint directory grows endlessly

er 2018 15:38 An: Winterstein, Bernd Cc: Kostas Kloudas; user; Stefan Richter; Till Rohrmann; Stephan Ewen Betreff: Re: number of files in checkpoint directory grows endlessly Could you share the logs to check possible failures to subsume or remove previous checkpoints? What is the sizes of t

Re: number of files in checkpoint directory grows endlessly

gt; Cc: Kostas Kloudas; user; s.rich...@data-artisans.com >> <mailto:s.rich...@data-artisans.com>; t...@data-artisans.com >> <mailto:t...@data-artisans.com>; step...@data-artisans.com >> <mailto:step...@data-artisans.com> >> Betreff: Re: number of files in che

Re: number of files in checkpoint directory grows endlessly

quot; directory next to the chk-xxx directory. > > > -Ursprüngliche Nachricht- > Von: Andrey Zagrebin [mailto:and...@data-artisans.com] > Gesendet: Donnerstag, 29. November 2018 10:39 > An: Kostas Kloudas > Cc: Winterstein, Bernd; user; Stefan Richter; Till Rohrmann; S

Re: number of files in checkpoint directory grows endlessly

Hi Bernd, Did you change 'state.checkpoints.num-retained’ in flink-conf.yaml? By default, only one checkpoint should be retained. Which version of Flink do you use? Can you check Job Master logs whether you see there warning like this: `Fail to subsume the old checkpoint`? Best, Andrey > On 29

Re: number of files in checkpoint directory grows endlessly

Hi Bernd, I think the Till, Stefan or Stephan (cc'ed) are the best to answer your question. Cheers, Kostas