Re: Parallelism under reactive scaling with slot sharing groups

y > using the master branch. > > > Best, > Weihua > > > On Tue, Jul 25, 2023 at 2:56 AM Allen Wang wrote: > >> Hello, >> >> Our job has operators of source -> sink -> global committer. We have >> created two slot sharing groups, one for source

Parallelism under reactive scaling with slot sharing groups

Hello, Our job has operators of source -> sink -> global committer. We have created two slot sharing groups, one for source and sink and one for global committer. The global committer has specified max parallelism of 1. No max parallelism set with the source/sink while there is a system level defa

How to clean up RocksDB local directory in K8s statefulset

Hi Folks, We created a stateful job using SessionWindow and RocksDB state backend and deployed it on Kubernetes Statefulset with persisted volumes. The Flink version we used is 1.14. After the job runs for some time, we observed that the size of the local RocksDB directory started to grow and the

StatsD metric name prefix change for task manager after upgrading to Flink 1.11

Hello, We noticed that after upgrading to Flink 1.11, the StatsD metric prefix is changed from the hostname to IP address of the task manager. The Flink job runs in a k8s cluster. Here is an example of metric reported to StatsD in Flink 1.10: flink-ingest-cx-home-page-feed-flink-task-manager-7f