Re: Consumer lag issues

2013-10-21 Thread Jun Rao
Max lag corresponds to the partition that lags the most. So it could stay high until all partitions are caught up. The second issue is weird. Lags across consumer groups should be more or less independent. Could this be a producer side issue? Do you see a sudden jump in the incoming byte rate? Th

Consumer lag issues

2013-10-21 Thread Jason Rosenberg
(I've changed the subject of this thread (was "Preparing for the 0.8 final release")) So, I'm not sure that my issue is exactly the same as that mentioned in the FAQ. Anyway, in looking at the MaxLag values for several consumers (not all consuming the same topics), it looks like there was a stran