Hi, I would like to start a discussion thread on KIP-932: Queues for Kafka. This KIP proposes an alternative to consumer groups to enable cooperative consumption by consumers without partition assignment. You end up with queue semantics on top of regular Kafka topics, with per-message acknowledgement and automatic handling of messages which repeatedly fail to be processed.
https://cwiki.apache.org/confluence/display/KAFKA/KIP-932%3A+Queues+for+Kafka Please take a look and let me know what you think. Thanks. Andrew