If you are using inMemoryKeyValueStore, the records are stored by
definition in memory. RocksDB is not used at all. This store will continue
to grow proportionally to your keyspace. If you do not have sufficient
memory to hold your entire dataset in memory, consider adding another
instance or switching to the RocksDB store

On Wed, Jul 17, 2019 at 6:22 AM Muhammed Ashik <ashi...@gmail.com> wrote:

> Kafka Streams version - 2.0.0
>
> Hi, in our streaming instance we are observing a steady growth in the
> off-heap memory (out of 2gb allocated memory 1.3 is reserved for heap
> memory and the ~700mb memory is utilised over a time of ~6hrs and the
> process is OOM killed eventually).
>
> we are using only the inMemoryKeyValueStore and not doing any persistence.
> as suggested the iterators are closed at the places it is used(using it in
> only once).
>
> Some forums were relating such issues with rocksdb but we are not
> specifying rocksdb in the config explicitly though. I was not sure whether
> it is used as a default in memory store by kafka streams.
>
> Regards
> Ashik
>

Reply via email to