Re: rebalance issues from mirrormaker

2013-06-20 Thread Jun Rao
Could you try the latest code in the 0.8 branch? It fixed one consumer bug that could cause the issue you saw. Thanks, Jun On Thu, Jun 20, 2013 at 8:29 AM, Yu, Libo wrote: > Sorry for my late reply. I used to watch the mailing list with Grokbase. > It somehow stops to update the mailing list

RE: rebalance issues from mirrormaker

2013-06-20 Thread Yu, Libo
Sorry for my late reply. I used to watch the mailing list with Grokbase. It somehow stops to update the mailing list and I thought you guys were too busy to reply to us:) In my case, I have 6 topics ech with 6 partitions. The total data volume is about 20G. For my question 1), is it expected to ha

Re: rebalance issues from mirrormaker

2013-06-10 Thread Jun Rao
How many total #topics/partitions are you mirroring? If that number is large, you will need to increase the # of retries and backoff time in the consumer in MirrorMaker. Thanks, Jun On Mon, Jun 10, 2013 at 8:21 AM, Yu, Libo wrote: > Hi, > > I come across several critical issues when benchmark