Guozhang, don't we just need latest partition offsets per consumer? what is the idea behind keeping all offsets "default" to forever?
On Fri, Aug 12, 2016 at 12:05 PM, Guozhang Wang <wangg...@gmail.com> wrote: > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK any more, and the brokers use heartbeats to detect if the consumer > has been failed and hence can be removed from the group or not. > > In addition, the consumer's committed offsets (i.e. "positions" as you > mentioned it) has an expiration parameter (default is "forever") based on > which the offsets will be automatically cleaned on the brokers as well. > > When all members are gone from a group, i.e. the group is empty, AND all > the group's previous consumer's committed offsets have all been expired, > the group registry will be deleted. > > > Guozhang > > On Thu, Aug 11, 2016 at 8:55 PM, yuanjia8...@163.com <yuanjia8...@163.com> > wrote: > > > Hi all， > > When I use kafka-consumer-groups.sh to delete new-consumer's group, > > the shell note that "Option [delete] is not valid with [new-consumer]. > Note > > that there's no need to delete group metadata for the new consumer as it > is > > automatically deleted when the last member leaves." > > How to understand it is automatically deleted when the last member > > leaves? > > Does it means the consumer's position could lost if the consumer > stop? > > > > > > Thanks and Regards > > > > > > > > YuanjiaLi > > > > > > -- > -- Guozhang > -- Radha Krishna, Proddaturi 253-234-5657
