Hi , Lets say I am using a kafka consumer with 4 consumer instances are part of a consumer group. I want to make sure that , if a consumer fails , because of any reason then it should be restarted on its own and should start from the offset it left behind.
I know using storm-kafka architecture , storm worker can restart , but in this case I am bound to not use storm because of some specific concerns. Please let me know if anyone is aware of this. >From outside we can manage it by adding shutdown-hook to consumer. Once it exits then restart the consumer , so basically by adding some watcher kind of stuff which checks periodically if consumer is on , and if not then turn it on.