Kafka Streams - unbounded memory growth - stateful processing (rocksdb)

2019-07-16 Thread Jayaraman, AshokKumar (CCI-Atlanta-CON)
Hi, In our streaming instance, the internal caching has been disabled and RocksDB caching has been enabled, with the override as shown below. Although the heap is restricted to 36GB, the memory utilization is going over 100GB in a week and eventually runs out of memory. As part of the profili

RE: cleanup.policy - doesn't accept compact,delete

2018-07-10 Thread Jayaraman, AshokKumar (CCI-Atlanta-CON)
t compact,delete Try to remove the space after the comma. -Matthias On 7/10/18 10:43 AM, Jayaraman, AshokKumar (CCI-Atlanta-CON) wrote: > Hi, > > When we try to use the same (square brackets), the internal topics are > failing to get created. Any suggestions? > > changelo

RE: cleanup.policy - doesn't accept compact,delete

2018-07-10 Thread Jayaraman, AshokKumar (CCI-Atlanta-CON)
e values which contain commas, we need to use square brackets. ex: --add-config cleanup.policy=[compact,delete] On Thu, Jun 7, 2018 at 8:49 AM, Jayaraman, AshokKumar (CCI-Atlanta-CON) < ashokkumar.jayara...@cox.com> wrote: > Hi, > > We are on Kafka version 1.0.0. Per the

cleanup.policy - doesn't accept compact,delete

2018-06-06 Thread Jayaraman, AshokKumar (CCI-Atlanta-CON)
Hi, We are on Kafka version 1.0.0. Per the below new feature, a topic can allow both compact and delete. I tried all the combinations, but they all fail to accept values that are not either compact OR delete. Is this feature valid in updated releases, since 0.10.2?If this is not a featu