Re: Kafka Streams - unbounded memory growth - stateful processing (rocksdb)

2019-07-16 Thread Patrik Kleindl
Hello Ashok Adding to what Sophie wrote, if you use a custom RocksDBConfigSetter then override the BlockBasedTableConfig like following and call options.setTableFormatConfig(tableConfig) at the end. BlockBasedTableConfig tableConfig = (BlockBasedTableConfig) options.tableFormatConfig(); tableConf

Re: Kafka Streams - unbounded memory growth - stateful processing (rocksdb)

2019-07-16 Thread Sophie Blee-Goldman
Hi Ashok, 1) RocksDB uses memory in four ways, one of which (iterators) *should* be negligible -- however if you have a very large number of them open at any one time, they can consume a lot of memory (until they are closed). If you are opening many iterators throughout the day, consider closing t

Kafka Streams - unbounded memory growth - stateful processing (rocksdb)

2019-07-16 Thread Jayaraman, AshokKumar (CCI-Atlanta-CON)
Hi, In our streaming instance, the internal caching has been disabled and RocksDB caching has been enabled, with the override as shown below. Although the heap is restricted to 36GB, the memory utilization is going over 100GB in a week and eventually runs out of memory. As part of the profili