Re: Consumers disappearing form __consumer_offsets

2016-04-12 Thread tao xiao
My understanding is that offset topic is a compact topic which should never be deleted but compacted. Is this true? If this is the case what does offsets.retention.minutes here really mean? On Tue, 12 Apr 2016 at 20:15 Sean Morris (semorris) wrote: > I have been seeing the same thing and now I u

Re: Consumers disappearing form __consumer_offsets

2016-04-12 Thread Sean Morris (semorris)
I have been seeing the same thing and now I understand why. Question is what happens to these topics then after the 24 hours? If I start publishing to them again do the consumers behave properly and only get the new records? Thanks, Sean On 4/11/16, 5:16 PM, "James Cheng" wrote: >This may be re

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread Tom Brown
Related: Can the __consumer_offsets topic be configured to retain offsets forever no matter how the rest of the server is configured? --Tom On Mon, Apr 11, 2016 at 3:19 PM, Morellato, Wanny < wanny.morell...@concur.com> wrote: > Thanks James, That was exactly what I was looking for. > > Wanny >

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread Morellato, Wanny
Thanks James, That was exactly what I was looking for. Wanny On 4/11/16, 2:16 PM, "James Cheng" wrote: >This may be related to offsets.retention.minutes. > >offsets.retention.minutes >Log retention window in minutes for offsets topic > >It defaults to 1440 minutes = 24 hours. > >-James >

Re: Consumers disappearing form __consumer_offsets

2016-04-11 Thread James Cheng
This may be related to offsets.retention.minutes. offsets.retention.minutes Log retention window in minutes for offsets topic It defaults to 1440 minutes = 24 hours. -James > On Apr 11, 2016, at 1:36 PM, Morellato, Wanny > wrote: > > Hi, > > I am trying to figure out why some of my consumers

Consumers disappearing form __consumer_offsets

2016-04-11 Thread Morellato, Wanny
Hi, I am trying to figure out why some of my consumers disappears from the list of active consumers… This is happening in my QA environment where sometimes no messages get published over the weekend. I am wondering if it is related to the default 24 hours log.cleaner.delete.retention.ms If tha