Damian,

Does this mean data is retained for infinite time limited only by disk
space.

-Sameer.

On Wed, Jul 26, 2017 at 3:53 PM, Sameer Kumar <sam.kum.w...@gmail.com>
wrote:

> got it. Thanks.
>
> On Wed, Jul 26, 2017 at 3:24 PM, Damian Guy <damian....@gmail.com> wrote:
>
>> The changelog is one created by kafka streams, then it is a compacted
>> topic
>> and the retention period is irrelevant. If it is one you have created
>> yourself and isn't compacted, then the data will be retained in the topic
>> for as long as the retention period.
>> If you use a non-compacted topic and the kafka-streams instance crashes
>> then that data may be lost from the state store as it will use the topic
>> to
>> restore its state.
>>
>> On Wed, 26 Jul 2017 at 10:24 Sameer Kumar <sam.kum.w...@gmail.com> wrote:
>>
>> > ok. Thanks.
>> >
>> > Actually, I had this confusion. Changelog like every Kafka topic would
>> have
>> > its retention period, lets say 2 days. and if the value on day1 for
>> key1 =
>> > 4 and data for key1 doesnt come for next 3 days. Would it still retail
>> the
>> > same value(key1=4) on day4.
>> >
>> > -Sameer.
>> >
>> > On Wed, Jul 26, 2017 at 2:22 PM, Damian Guy <damian....@gmail.com>
>> wrote:
>> >
>> > > Sameer,
>> > >
>> > > For a KeyValue store the changelog topic is a compacted topic so
>> there is
>> > > no retention period. You will always retain the latest value for a
>> key.
>> > >
>> > > Thanks,
>> > > Damian
>> > >
>> > > On Wed, 26 Jul 2017 at 08:36 Sameer Kumar <sam.kum.w...@gmail.com>
>> > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > Retention period for state stores are clear(default, otherwise
>> > specified
>> > > by
>> > > > TimeWindows.until). Intrigued to know the retention period for key
>> > > values.
>> > > >
>> > > > The use case is something like I am reading from a windowed store,
>> and
>> > > > using plain reduce() with out any time windows. Would the values be
>> > > > retained foreever.
>> > > >
>> > > > -Sameer.
>> > > >
>> > >
>> >
>>
>
>

Reply via email to