Re: Metrics with labels

2023-10-17 Thread Chesnay Schepler
> I think this is a general issue with the Flink metrics. Not quite. There are a few instance in Flink were code wasn't updated to encode metadata as additional labels, and the RocksDB metrics may be one of them. Also for RocksDB, you could try setting "state.backend.rocksdb.metrics.column-fam

RocksDB: Memory is slowly increasing over time

2023-10-17 Thread Eifler, Patrick
Hello, We are running Flink jobs on K8s and using RocksDB as state backend. It is connected to S3 for checkpointing. We have multiple states in the job (mapstate and value states). We are seeing a slow but stable increase over time on the memory consumption. We only see this in our jobs connect

Metrics with labels

2023-10-17 Thread Lars Skjærven
Hello, We're experiencing difficulties in using Flink metrics in a generic way since various properties are included in the name of the metric itself. This makes it difficult to generate sensible (and general) dashboards (with aggregations). One example is the metric for rocksdb estimated live da

Re: [EXTERNAL]Re: Next Release of the Flink Kubernetes Operator

2023-10-17 Thread Gyula Fóra
Building your own custom operator image is also fairly straightforward and is also a good exercise to make sure you can easily backport critical fixes into your prod envs in the future :) Cheers, Gyula On Tue, Oct 17, 2023 at 10:48 AM Niklas Wilcke wrote: > Hi Gyula, > > thank you very much for

Re: [EXTERNAL]Re: Next Release of the Flink Kubernetes Operator

2023-10-17 Thread Niklas Wilcke
Hi Gyula, thank you very much for the update about the release schedule and for pointing me to the snapshot images. This is indeed very helpful and we will consider our options now. Regards, Niklas > On 16. Oct 2023, at 17:56, Gyula Fóra wrote: > > Hi Niklas! > > We weren't planning a 1.6.1