Hello, We are running Flink jobs on K8s and using RocksDB as state backend. It is connected to S3 for checkpointing. We have multiple states in the job (mapstate and value states). We are seeing a slow but stable increase over time on the memory consumption. We only see this in our jobs connected to RocksDB.
We are currently using the default memory setting (state-backend-rocksdb-memory-managed=true). Now we are wondering what a good alternative setting would be. We want to try to enable thestate.backend.rocksdb.memory.partitioned-index-filters but it only takes effect if the managed memory is turned off, so we need to figure out what would be a good amount for memory.fixed-per-slot. Any hint what a good indicator for that calculation would be? Any other experience if someone has seen similar behavior before would also be much appreciated. Thanks! Best Regards -- Patrick Eifler
