Hello Drew,

Do you see any rebalance failure exceptions in the consumer log?

Guozhang


On Mon, Nov 18, 2013 at 2:14 PM, Drew Goya <d...@gradientx.com> wrote:

> So I've run into a problem where occasionally, some partitions within a
> topic end up in a "none" owner state for a long time.
>
> I'm using the high-level consumer on several machines, each consumer has 4
> threads.
>
> Normally when I run the ConsumerOffsetChecker, all partitions have owners
> and similar lag.
>
> Occasionally I end up in this state:
>
> trackingGroup   Events2                        32  552506856
> 569853398       17346542        none
> trackingGroup   Events2                        33  553649131
> 569775298       16126167        none
> trackingGroup   Events2                        34  552380321
> 569572719       17192398        none
> trackingGroup   Events2                        35  553206745
> 569448821       16242076        none
> trackingGroup   Events2                        36  553673576
> 570084283       16410707        none
> trackingGroup   Events2                        37  552669833
> 569765642       17095809        none
> trackingGroup   Events2                        38  553147178
> 569766985       16619807        none
> trackingGroup   Events2                        39  552495219
> 569837815       17342596        none
> trackingGroup   Events2                        40  570108655
> 570111080       2425
>  trackingGroup_host6-1384385417822-23157ae8-0
> trackingGroup   Events2                        41  570288505
> 570291068       2563
>  trackingGroup_host6-1384385417822-23157ae8-0
> trackingGroup   Events2                        42  569929870
> 569932330       2460
>  trackingGroup_host6-1384385417822-23157ae8-0
>
> I'm at the point where I'm considering writing my own client but hopefully
> the user group has the answer!
>
> I am using this commit of 8.0 on both the brokers and clients:
> d4553da609ea9af6db8a79faf116d1623c8a856f
>



-- 
-- Guozhang

Reply via email to