Kerberos ticket fails to renew

2018-09-10 Thread AshokKumar J
When the Kafka stream app is started, the following jaas file is being used. However, the tickets are not being renewed automatically by the stream application. It fails with the exception below after the ticket expires. What should we do to keep the Kerberos ticket automatically renewed? KafkaCli

Re: Kafka streams - runs out of memory

2018-08-25 Thread AshokKumar J
lication is only using key-value stores, so should not have > the segmentation amplification factor): > > > https://issues.apache.org/jira/browse/KAFKA-5122?focusedCommentId=15984467&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-15984467 > > &

Re: Kafka streams - runs out of memory

2018-08-19 Thread AshokKumar J
that > involves your business logic, just the sketch of the code is fine). > > > Guozhang > > On Fri, Aug 17, 2018 at 8:52 AM, AshokKumar J > wrote: > > > Hi, > > Any thoughts on the below issue? I think the behavior should be > > reproducible if we perfo

Re: Kafka streams - runs out of memory

2018-08-17 Thread AshokKumar J
approx. Overtime the app runs out of the total memory within 24 hours. Thanks, Ashok On Wed, Aug 15, 2018 at 5:15 AM, AshokKumar J wrote: > Disabling the stream cache prevents the unbounded memory usage, however > the throughput is low (with ROCKSDB cache enabled). Can you please advise >

Re: Kafka streams - runs out of memory

2018-08-15 Thread AshokKumar J
Disabling the stream cache prevents the unbounded memory usage, however the throughput is low (with ROCKSDB cache enabled). Can you please advise why the cache objects reference doesn't get released in time (for GC cleanup) and grows continuously? On Tue, Aug 14, 2018 at 11:17 PM, AshokKu

Kafka streams - runs out of memory

2018-08-14 Thread AshokKumar J
Hi, we have a stream application that uses the low level API. We persist the data into the key value state store. For each record that we retrieve from the topic we perform a lookup against the store to see if it exists, if it does then we update the existing, else we simply add the new record.