Safely cancel partition reassignment task

2015-08-19 Thread tao xiao
Hi team, What is the best way to cancel an in progress partition reassignment job? I know it saves the json in /admin/reassign_partition in zk. Is it ok to delete the znode?

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-19 Thread Jun Rao
Ok, thanks everyone for the feedback. Based on the feedback, I'd recommend that we do an 0.8.2.2 release including just the two snappy bug fixes. Jun On Tue, Aug 18, 2015 at 12:59 PM, Gwen Shapira wrote: > Any objections if I leave KAFKA-2114 (setting min.insync.replicas default) > out? > > The

Sys CPU and load average spikes with kafka cluster on Virtual Box

2015-08-19 Thread Anuja Pundlik (apundlik)
Hi All, We are running into a situation where System CPU (as seen in top) is increasing to 67%. Also the load average of system (as seen in top) increases to 25 Following is the setup. 1. One Zookeeper, 3 kafka brokers 2. This cluster is running on Centos 6.5 OS * Centos OS is the

Error while Consuming message

2015-08-19 Thread Jigar Shah
Hi, I have one kafka Broker and 2 Zookeeper up and running on same machine. I am creating the Topic at runtime and producing the event. But while consuming i am getting error. ERROR [Replica Manager on Broker 0]: Error when processing fetch request for partition [12,0] offset 41 from consumer wit

Re: Is Kafka suitable for high volume, real-time sessions ?

2015-08-19 Thread lrnop
All, Ahhhg! So sorry - the diagram referenced in the original post (a png) got stripped (Of course). Find below an attempt to reproduce the diagram in plain ascii. The png is available by request if anyone wants to look at it. To summarise the question again: 1. We have a potent

Re: How to skip malformed messages in a custom Kafka decoder?

2015-08-19 Thread Sharninder
What do you mean by malformed messages? Consuming messages and what to do with them is the application's logic. Consume them, if they're not relevant pick up the next message. On Wed, Aug 19, 2015 at 1:10 PM, Petr Novak wrote: > Hi all, > ... by returning null? > > Many thanks, > Petr > -- -

How to skip malformed messages in a custom Kafka decoder?

2015-08-19 Thread Petr Novak
Hi all, ... by returning null? Many thanks, Petr