Re: How to be notified by Kafka stream during partitions rebalancing

2019-04-09 Thread John Roesler
Hi Pierre, If you're using a Processor (or Transformer), you might be able to use the `close` method for this purpose. Streams invokes `close` on the Processor when it suspends the task at the start of the rebalance, when the partitions are revoked. (It invokes `init` once the rebalance is complet

Re: How to be notified by Kafka stream during partitions rebalancing

2019-04-04 Thread Pierre Coquentin
thanks :) On Thu, Apr 4, 2019 at 11:11 AM Dimitry Lvovsky wrote: > You can detect state changes in your streaming app by implementing > KafkaStreams.StateListener, > and then registering that with your KafkaStreeams Object e.g new > KafkaStreams(...).setStateListener(); > > Hope this helps. > >

Re: How to be notified by Kafka stream during partitions rebalancing

2019-04-04 Thread Dimitry Lvovsky
You can detect state changes in your streaming app by implementing KafkaStreams.StateListener, and then registering that with your KafkaStreeams Object e.g new KafkaStreams(...).setStateListener(); Hope this helps. On Thu, Apr 4, 2019 at 10:52 AM Pierre Coquentin wrote: > Hi, > > We have a cach

How to be notified by Kafka stream during partitions rebalancing

2019-04-04 Thread Pierre Coquentin
Hi, We have a cache in a processor based on assigned partitions and when Kafka revokes those partitions we would like to flush the cache. The method punctuate is neet to do that except that as a client of Kafka stream, I am not notified during a revoke. I found the same question on StackOverflow h