Re: Partition election on consumer

2013-10-11 Thread Markus Roder
Thanks Neha, really appreciate your assistance 2013/10/9 Neha Narkhede > Kafka's consumer rebalancing strategy is explained in detail here - > http://kafka.apache.org/documentation.html#distributionimpl > Hope that helps! > > -Neha > > > On Tue, Oct 8, 2013 at 11:42 PM, Markus Roder >wrote: >

Re: Partition election on consumer

2013-10-09 Thread Neha Narkhede
Kafka's consumer rebalancing strategy is explained in detail here - http://kafka.apache.org/documentation.html#distributionimpl Hope that helps! -Neha On Tue, Oct 8, 2013 at 11:42 PM, Markus Roder wrote: > Hi Neha, > > thanks for this information. > Can you give me a hint for implementing a own

Re: Partition election on consumer

2013-10-08 Thread Markus Roder
Hi Neha, thanks for this information. Can you give me a hint for implementing a own rebalancing strategy? Thanks in advance Markus 2013/10/8 Neha Narkhede > Currently there is no way to invoke a callback on the rebalance operation. > But this is certainly something to consider for Kafka 0.9 s

Re: Partition election on consumer

2013-10-08 Thread Neha Narkhede
Currently there is no way to invoke a callback on the rebalance operation. But this is certainly something to consider for Kafka 0.9 since we are planning a client rewrite for that release. You can find the proposal in progress here - https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite

Partition election on consumer

2013-10-08 Thread Markus Roder
Hi, we currently face a "problem" on our consumer cluster, which may have a simple solution. Never the less I could not find this solution yet. Description of problem: 1 kafka topic with 24 partitions (kafka version 0.8 Beta1 2 or more consumers in same consumer group. Each consumer processes its