Re: [Keeping equal no of messages in partitions ]

2014-02-01 Thread Guozhang Wang
Update the FAQ wiki page for this question: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whydataisnotevenlydistributedamongpartitionswhenpartitioningkeyisnotspecified ? On Fri, Jan 31, 2014 at 8:53 PM, Jun Rao wrote: > You can use a customized partitioner and provide a partitionin

Re: [Keeping equal no of messages in partitions ]

2014-02-01 Thread Neha Narkhede
Thanks for updating the FAQ, Guozhang! On Sat, Feb 1, 2014 at 10:32 AM, Guozhang Wang wrote: > Update the FAQ wiki page for this question: > > > https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whydataisnotevenlydistributedamongpartitionswhenpartitioningkeyisnotspecified > ? > > > On F

Preparing for 0.8.1 release

2014-02-01 Thread Neha Narkhede
Hi, I cleaned up the JIRAs in preparation for the 0.8.1 release. Here are some JIRAsmarked for 0.8.1 that either n

Re: [Keeping equal no of messages in partitions ]

2014-02-01 Thread Abhishek Bhattacharjee
Thanks for that :-) On Sun, Feb 2, 2014 at 12:17 AM, Neha Narkhede wrote: > Thanks for updating the FAQ, Guozhang! > > > On Sat, Feb 1, 2014 at 10:32 AM, Guozhang Wang wrote: > > > Update the FAQ wiki page for this question: > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FA

Re: Consumer Group Rebalance Issues

2014-02-01 Thread Drew Goya
Hey all, this issue has recently popped up again. I've got a member of a consumer group stuck in a rebalance loop. It attempts to claim partitions but those are always conflicted: 2014-02-02 01:46:22 k.c.ZookeeperConsumerConnector [INFO] [trackingGroup_host061.pe1i.gradientx.com-1391301920791-99

Re: Consumer Group Rebalance Issues

2014-02-01 Thread Jun Rao
What is host062 doing when the conflict occurred? Is it doing rebalance too? If so, does it see the same set of partitions and consumers as host061 does? Thanks, Jun On Sat, Feb 1, 2014 at 5:53 PM, Drew Goya wrote: > Hey all, this issue has recently popped up again. I've got a member of a >

Connection reset by peer

2014-02-01 Thread Ranjith Venkatesan
Hi , We are evaluating kafka 0.8 for our product as a queue system. Our architecture remains simple. Our producer (single) will send mesages to any of the topics in broker. Thread will be running for each of the topic for every 10 secs,which in turn consume from its corresponding topic. F