Re: Consumers disappearing form __consumer_offsets

2016-04-12 Thread tao xiao
My understanding is that offset topic is a compact topic which should never be deleted but compacted. Is this true? If this is the case what does offsets.retention.minutes here really mean? On Tue, 12 Apr 2016 at 20:15 Sean Morris (semorris) wrote: > I have been seeing the same thing and now I u

Re: Consumers disappearing form __consumer_offsets

2016-04-12 Thread Sean Morris (semorris)
I have been seeing the same thing and now I understand why. Question is what happens to these topics then after the 24 hours? If I start publishing to them again do the consumers behave properly and only get the new records? Thanks, Sean On 4/11/16, 5:16 PM, "James Cheng" wrote: >This may be re

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread Tom Brown
Related: Can the __consumer_offsets topic be configured to retain offsets forever no matter how the rest of the server is configured? --Tom On Mon, Apr 11, 2016 at 3:19 PM, Morellato, Wanny < wanny.morell...@concur.com> wrote: > Thanks James, That was exactly what I was looking for. > > Wanny >

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread Morellato, Wanny
Thanks James, That was exactly what I was looking for. Wanny On 4/11/16, 2:16 PM, "James Cheng" wrote: >This may be related to offsets.retention.minutes. > >offsets.retention.minutes >Log retention window in minutes for offsets topic > >It defaults to 1440 minutes = 24 hours. > >-James >

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread James Cheng
This may be related to offsets.retention.minutes. offsets.retention.minutes Log retention window in minutes for offsets topic It defaults to 1440 minutes = 24 hours. -James > On Apr 11, 2016, at 1:36 PM, Morellato, Wanny > wrote: > > Hi, > > I am trying to figure out why some of my consumers