changelog topic with in-memory state store

2017-01-10 Thread Daisuke Moriya
Hi. I am developing a simple log counting application using Kafka Streams 0.10.1.1. Its implementation is almost the same as the WordCountProcessor in the confluent document [http://docs.confluent.io/3.1.1/streams/developer-guide.html#processor-api]. I am using in-memory state store, its key is

Re: changelog topic with in-memory state store

2017-01-12 Thread Daisuke Moriya
already cached. However the in-memory store will write each update to the changelog (regardless of context.commit), which seems to be the issue you have? When you say large, how large? Have you tested it and observed that it puts load on the broker? Thanks, Damian On Wed, 11 Jan 2017 at 06:10 Daisuke