Re: Issue with KTable State Store

2016-08-04 Thread Guozhang Wang
I remember observing this issue, that whenever you received a new value and tries to get the old aggregate value from store, it always returns null and hence you never aggregate the old value with new record. I remember I fixed that issue but cannot remember how.. So I would recommend: 1) Try comp

Re: Issue with KTable State Store

2016-08-03 Thread Srinidhi Muppalla
Hi Guozahang, I believe we are using RocksDB. We are not using the Processor API, just simple map and countByKey functions so it is using the default KeyValue Store. Thanks! Srinidhi Hello Srinidhi, Are you using RocksDB as well like in the WordCountDemo for your aggregation operator? Guozha

Re: Issue with KTable State Store

2016-08-03 Thread Guozhang Wang
Hello Srinidhi, Are you using RocksDB as well like in the WordCountDemo for your aggregation operator? Guozhang On Tue, Aug 2, 2016 at 5:20 PM, Srinidhi Muppalla wrote: > Hey All, > > We are having issues successfully storing and accessing a Ktable on our > cluster which happens to be on AWS.

Issue with KTable State Store

2016-08-02 Thread Srinidhi Muppalla
Hey All, We are having issues successfully storing and accessing a Ktable on our cluster which happens to be on AWS. We are trying to store a Ktable of counts of ’success' and ‘failure’ strings, similar to the WordCountDemo in the documentation. The Kafka Streams application that creates the KT