Re: Creating read-only state stores from a compacted topic

2017-05-17 Thread Matthias J. Sax
Hey, at the moment there is no official API for that -- however, using `KSTreamBuilder#table()` we internally do the exact some thing -- we don't create an additional changelog topic, but use the original input topic for that. Thus, it might make sense to expose this as official API at Processor

Re: Creating read-only state stores from a compacted topic

2017-05-17 Thread Frank Lyaruu
Definitely! Thanks, I'll try this. On Wed, May 17, 2017 at 10:59 AM, Damian Guy wrote: > Sorry misread your question! > If the local state is destroyed there will be no checkpoint file and the > input topic will be read from the earliest offset. So it will restore all > state. > > On Wed, 17 May

Re: Creating read-only state stores from a compacted topic

2017-05-17 Thread Damian Guy
Sorry misread your question! If the local state is destroyed there will be no checkpoint file and the input topic will be read from the earliest offset. So it will restore all state. On Wed, 17 May 2017 at 09:57 Damian Guy wrote: > Hi Frank, > > Stores.create("store") > .withKeys(Serdes.

Re: Creating read-only state stores from a compacted topic

2017-05-17 Thread Damian Guy
Hi Frank, Stores.create("store") .withKeys(Serdes.String()) .withValues(Serdes.String()) .persistent() .disableLogging() .build(); Does that help? Thanks, Damian On Wed, 17 May 2017 at 06:09 Frank Lyaruu wrote: > Hi Kafka people, > > I'm using the lo

Creating read-only state stores from a compacted topic

2017-05-16 Thread Frank Lyaruu
Hi Kafka people, I'm using the low level API that often creates a simple state store based on a (single partition, compacted) topic (It feeds all messages and simply stores all those messages as-is). Now all these stores get their own 'changelog' topic, to back the state store. This is fine, but