Re: Question about RocksDB performance tunning

2020-07-02 Thread Peter Huang
tebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/PredefinedOptions.java > > Best > Yun Tang > -- > *From:* Peter Huang > *Sent:* Friday, July 3, 2020 13:31 > *To:* user > *Subject:* Question about RocksDB performance tunning &

Re: Question about RocksDB performance tunning

2020-07-02 Thread Yun Tang
stion about RocksDB performance tunning Hi, I have a stateful Flink job with 500k QPS. The job basically counts the message number on a combination key with 10 minutes tumbling window. If I use memory state backend, the job can run without lag but periodically fails due to OOM. If I turn up Ro

Question about RocksDB performance tunning

2020-07-02 Thread Peter Huang
Hi, I have a stateful Flink job with 500k QPS. The job basically counts the message number on a combination key with 10 minutes tumbling window. If I use memory state backend, the job can run without lag but periodically fails due to OOM. If I turn up RocksDB state backend, it will have a high Ka