Re: Kafka InvalidStateStoreException

2017-09-15 Thread Matthias J. Sax
Hi, in case of a rebalance, partitions are reassigned and thus (shards) of a store might move from one instance/thread to another. This could potentially happen anytime, and you need to rediscover the shard/store afterwards. Thus, your code must catch this exception and you can retry the query aft

Re: Kafka InvalidStateStoreException

2017-09-15 Thread Jari Väimölä
Hello, Here is the code snipplet. 145 146public ReadOnlyKeyValueStore getQuotaStore() { 147return this.runner.streams.store("quota-table", QueryableStoreTypes.keyValueStore()); 148} 149 Thanks, Jari On 15.09.2017 12:30, Ted Yu wrote: bq. at com.mytest.csd.kafka.KafkaDedupl

Re: Kafka InvalidStateStoreException

2017-09-15 Thread Ted Yu
bq. at com.mytest.csd.kafka.KafkaDeduplicator.getQuotaStore(KafkaDe duplicator.java:147) Can you show us relevant code snippet for the above method ? On Fri, Sep 15, 2017 at 2:20 AM, Jari Väimölä wrote: > Hello all, > I have an apache kafka stream application running in docker container. It >

Kafka InvalidStateStoreException

2017-09-15 Thread Jari Väimölä
Hello all, I have an apache kafka stream application running in docker container. It writes to three output topics. In my environment there are two brokers and one zookeeper, all running on different hosts. After starting my stream application following error logs are printed: INFO [2017-09-1