Re: Improving I/O on KafkaStreams

2021-12-20 Thread Bruno Cadonna
Hi Murilo, Have you checked out the following blog post on tuning performance of RocksDB state stores [1] especially the section on high disk I/O and write stalls [2]? Do you manage the off-heap memory used by RocksDB as described in the Streams docs [3]? I do not know what may have caused

Improving I/O on KafkaStreams

2021-12-20 Thread Murilo Tavares
Hi I have a KafkaStreams application with a reasonably complex, stateful topology. By monitoring it, we can say for sure that it is bounded by writing I/O. This has become way worse after we upgraded KafkaStreams from 2.4 to 2.8. (even though we disabled warm-up replicas by setting "acceptable.reco