AW: number of files in checkpoint directory grows endlessly

2018-12-10 Thread Bernd.Winterstein
;> Sent: Tuesday, December 4, 2018 17:40 To: and...@data-artisans.com<mailto:and...@data-artisans.com> Cc: k.klou...@data-artisans.com<mailto:k.klou...@data-artisans.com>; user@flink.apache.org<mailto:user@flink.apache.org>; s.rich...@data-artisans.com<mailto:s.rich...@da

AW: number of files in checkpoint directory grows endlessly

2018-12-06 Thread Bernd.Winterstein
er@flink.apache.org<mailto:user@flink.apache.org>; s.rich...@data-artisans.com<mailto:s.rich...@data-artisans.com>; t...@data-artisans.com<mailto:t...@data-artisans.com>; step...@data-artisans.com<mailto:step...@data-artisans.com> Subject: AW: number of files in checkpoint directory

AW: number of files in checkpoint directory grows endlessly

2018-12-04 Thread Bernd.Winterstein
ailto:user@flink.apache.org>; s.rich...@data-artisans.com<mailto:s.rich...@data-artisans.com>; t...@data-artisans.com<mailto:t...@data-artisans.com>; step...@data-artisans.com<mailto:step...@data-artisans.com> Subject: AW: number of files in checkpoint directory grows endlessly

AW: number of files in checkpoint directory grows endlessly

2018-12-04 Thread Bernd.Winterstein
Sorry for the late answer. I haven’t been in the office. The logs show no problems. The files that remain in the shared subfolder are almost all 1121 bytes. Except the files from the latest checkpoint (30 files for all operators) For each historic checkpoint six files remain (parallelism is 6) c

AW: number of files in checkpoint directory grows endlessly

2018-11-29 Thread Bernd.Winterstein
Hi We use Flink 1..6.2. As for the checkpoint directory there is only one chk-xxx directory. Therefore if would expect only one checkpoint remains. The value of 'state.checkpoints.num-retained’ is not set explicitly. The problem is not the number of checkpoints but the number of files in the "sh