Hi I have a KafkaStreams application with a reasonably complex, stateful topology. By monitoring it, we can say for sure that it is bounded by writing I/O. This has become way worse after we upgraded KafkaStreams from 2.4 to 2.8. (even though we disabled warm-up replicas by setting "acceptable.recovery.lag" to Long.MAX_VALUE)
So my question is: how can we decrease writing to disk frequency in a KafkaStreams application? Maybe tweaking memtable in the underlying Rocksdb? Any other suggestions? Also, any ideas why upgrading KafkaStreams would affect its i/o performance? Any changes that might have caused an instance to do more writes? Thanks Murilo
