log cleaner thread crashes with different log.cleaner.io.buffer.size

2017-04-02 Thread Shuai Lin
Hi, Recently we updated from kafka 0.10.0.1 to 0.10.2.1, and found the log cleaner thread crashed with this error: [2017-03-24 10:41:03,926] INFO [kafka-log-cleaner-thread-0], Starting > (kafka.log.LogCleaner) > [2017-03-24 10:41:04,177] INFO Cleaner 0: Beginning cleaning of log > app-topic-2017

Re: log cleaner thread crashes with different log.cleaner.io.buffer.size

2017-04-04 Thread Shuai Lin
s.java:111) > at kafka.log.Cleaner.cleanInto(LogCleaner.scala:468) Also worth mentioning that we are still using log.message.format.version = 0.9.0.0 because there are still some old consumers. Could this be related to the problem? On Sun, Apr 2, 2017 at 11:46 PM, Shuai Lin wrote: > H

Re: log cleaner thread crashes with different log.cleaner.io.buffer.size

2017-04-04 Thread Shuai Lin
Filed a JIRA for this. https://issues.apache.org/jira/browse/KAFKA-5010 (also forwarded to the dev list.) On Tue, Apr 4, 2017 at 7:16 PM, Shuai Lin wrote: > After digging a bit into the source code of LogCleaner class, i realized > maybe i should not try to fix the crash by increasi

Re: Request to subscribe

2017-04-04 Thread Shuai Lin
To subscribe you should send a message to users-subscr...@kafka.apache.org. Please follow the instructions on https://kafka.apache.org/contact . On Wed, Apr 5, 2017 at 2:36 PM, Vidya Priyadarshni Narayan < vidya.nara...@go-jek.com> wrote: > -- > > Thanks > nVidia >