If you are using inMemoryKeyValueStore, the records are stored by definition in memory. RocksDB is not used at all. This store will continue to grow proportionally to your keyspace. If you do not have sufficient memory to hold your entire dataset in memory, consider adding another instance or switching to the RocksDB store
On Wed, Jul 17, 2019 at 6:22 AM Muhammed Ashik <ashi...@gmail.com> wrote: > Kafka Streams version - 2.0.0 > > Hi, in our streaming instance we are observing a steady growth in the > off-heap memory (out of 2gb allocated memory 1.3 is reserved for heap > memory and the ~700mb memory is utilised over a time of ~6hrs and the > process is OOM killed eventually). > > we are using only the inMemoryKeyValueStore and not doing any persistence. > as suggested the iterators are closed at the places it is used(using it in > only once). > > Some forums were relating such issues with rocksdb but we are not > specifying rocksdb in the config explicitly though. I was not sure whether > it is used as a default in memory store by kafka streams. > > Regards > Ashik >
