Re: log cleaner thread crashes with different log.cleaner.io.buffer.size

2017-04-04 Thread Shuai Lin
After digging a bit into the source code of LogCleaner class, i realized maybe i should not try to fix the crash by increasing the log.cleaner.io.buffer.size: the cleaner would automatically grow the buffer so that it can hold at least one record. Also for the last error i pasted above, i.e. "larg

Re: log cleaner thread crashes with different log.cleaner.io.buffer.size

2017-04-04 Thread Shuai Lin
Filed a JIRA for this. https://issues.apache.org/jira/browse/KAFKA-5010 (also forwarded to the dev list.) On Tue, Apr 4, 2017 at 7:16 PM, Shuai Lin wrote: > After digging a bit into the source code of LogCleaner class, i realized > maybe i should not try to fix the crash by increasing the > log

best practices to handle large messages

2017-04-04 Thread Mohammad Kargar
What are best practices to handle large messages (2.5 MB) in Kafka? Thanks, Mohammad

Regarding Kafka Audit tool for auditing Kafka Data

2017-04-04 Thread Vidya Priyadarshni Narayan
Hi, I am a product engineer at Go-Jek and we are using Kafka in our Data Engineering team. I came across this slide share presentation on https://www.slideshare.net/JonBringhurst/kafka-audit-kafka-meetup-january-27th-2015 I would like to know if this Kafka Audit tool is open sourced as well / get

Request to subscribe

2017-04-04 Thread Vidya Priyadarshni Narayan
-- Thanks nVidia

Re: Request to subscribe

2017-04-04 Thread Shuai Lin
To subscribe you should send a message to users-subscr...@kafka.apache.org. Please follow the instructions on https://kafka.apache.org/contact . On Wed, Apr 5, 2017 at 2:36 PM, Vidya Priyadarshni Narayan < vidya.nara...@go-jek.com> wrote: > -- > > Thanks > nVidia >