Hello Flink Community,
I’m running a Flink pipeline that uses a tumbling window and incremental
checkpoint with RocksDB backed by s3. The number of objects in the window is
stable but overtime the checkpoint size grows seemingly unbounded. Within the
first few hours after bringing the Flink pip
-Matt
From: Till Rohrmann
Date: Wednesday, May 27, 2020 at 9:00 AM
To: Guowei Ma
Cc: "Wissman, Matt" , "user@flink.apache.org"
Subject: Re: Tumbling windows - increasing checkpoint size over time
LEARN FAST: This email originated outside of HERE.
Please do not click on li
consistent (follows the
same pattern).
Changing the checkpoint interval seemed to fix the problem of the large and
growing checkpoint size but I’m not sure why.
Thanks!
-Matt
From: Till Rohrmann
Date: Thursday, May 28, 2020 at 10:48 AM
To: "Wissman, Matt"
Cc: Guowei Ma , "user@f
: {{ .Values.flink.checkpointUrl }}/checkpoints
state.savepoints.dir: {{ .Values.flink.checkpointUrl }}/savepoints
state.backend.incremental: true
state.backend.rocksdb.localdir: /tmp/taskmanager
Thanks!
-Matt
From: Guowei Ma
Date: Monday, June 1, 2020 at 1:01 AM
To: "Wissman, Matt"
