Hi - I have a Kafka Streams application that needs to run on multiple instances. It fetches metadata from all local stores and has an http query layer for interactive queries. In some cases when I have new instances deployed, store migration takes place making the current metadata invalid. Here are my questions regarding some of the best practices to be followed to handle this issue of store migration -
- When the migration is in process, a query for the metadata may result in InvalidStateStoreException - is it a good practice to always have a retry semantics based query for the metadata ? - Should I check KafkaStreams.state() and only assume that I have got the correct metadata when the state() call returns Running. If it returns Rebalancing, then I should re-query. Is this correct approach ? regards. -- Debasish Ghosh http://manning.com/ghosh2 http://manning.com/ghosh Twttr: @debasishg Blog: http://debasishg.blogspot.com Code: http://github.com/debasishg
