If you have 1000 partitions and 500 consumers, each consumer should be
consuming 2 partitions. You can verify this using ConsumerOffsetChecker.
Which version of Kafka are you using? If it's 0.8, you may want to take a
look at
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whydataisnoteve
consumer mapping is client side logic to the high level consumer, yes.
partition -> client mapping is automatically handled by the high level
consumer. this is organized by groupId
when groupId is the same the consumers operate together and consumers
within the group do not see the same informat
