Re: Questions about single consumer per partition approach

2016-12-21 Thread Alexei Levashov
Hello, I appreciate your advice. My major concern is - if consumer thread didn’t send heartbeat for time period set in *session.timeout.ms * property it should look dead for the broker. Re-balancing process is not triggered for manually assigned consumers as API doc say

Re: Questions about single consumer per partition approach

2016-12-21 Thread R Krishna
Newbie here, Q2) Think, there is no rebalance if you go with manual partition assignment (assign(List) ), but were you looking for subscribe(List, ConsumerRebalanceListener)

Re: Questions about single consumer per partition approach

2016-12-21 Thread Alexei Levashov
Thank you Ben, I appreciate your answer. I AM using the key to send messages from the selected producer to a selected partition – Q1 covered. If Q2 seems obscure I could add that I am talking about Java client library and basically asked for clarification to the API doc statement that in case of

Re: Questions about single consumer per partition approach

2016-12-21 Thread Ben Stopford
Hi Alexi Typically you would use a key to guarantee that messages with the same key have a global ordering, rather than using manual assignment. Kafka will send all messages with the same key to the same partition. If you need global ordering, spanning all messages from a single producer, you can