; > > > Gwen,
> > > >
> > > > Thanks for the detailed reply.
> > > >
> > > > That makes it more clear for me.
> > > >
> > > > Heath
> > > >
> > > > -Original Message-
> > > &
gt; That makes it more clear for me.
> > >
> > > Heath
> > >
> > > -Original Message-
> > > From: Gwen Shapira [mailto:g...@confluent.io]
> > > Sent: Tuesday, April 05, 2016 6:13 PM
> > > To: users@kafka.apache.org
> > > Subject: R
es it more clear for me.
> >
> > Heath
> >
> > -Original Message-
> > From: Gwen Shapira [mailto:g...@confluent.io]
> > Sent: Tuesday, April 05, 2016 6:13 PM
> > To: users@kafka.apache.org
> > Subject: Re: Log Retention: What gets deleted
> >
> Sent: Tuesday, April 05, 2016 6:13 PM
> To: users@kafka.apache.org
> Subject: Re: Log Retention: What gets deleted
>
> I think you got it almost right. The missing part is that we only delete
> whole partition segments, not individual messages.
>
> As you are writing messages,
Gwen,
Thanks for the detailed reply.
That makes it more clear for me.
Heath
-Original Message-
From: Gwen Shapira [mailto:g...@confluent.io]
Sent: Tuesday, April 05, 2016 6:13 PM
To: users@kafka.apache.org
Subject: Re: Log Retention: What gets deleted
I think you got it almost right
I think you got it almost right. The missing part is that we only delete
whole partition segments, not individual messages.
As you are writing messages, every X bytes or Y milliseconds, a new file
gets created for the partition to store new messages in. Those files are
called segments.
The segment
Hi,
I have some questions about the log retention and specifically what gets
deleted.
I have a test app where I am writing 10 logs to the topic every second.
What I would expect is a lag in a group would be somewhere around 10 if I have
retention.ms at 1000.
What I am seeing that the lag cont
