Hi there I've just started evaluating Kafka as an additional message broker to be supported by the platform I work for. Currently, we support AMQP and JMS.
One of our use-cases for messaging is to use queues for distributing tasks to workers as they become available. I've noticed that by using a common group id and multiple partitions, the messages are fairly distributed among consumers of a given topic, but still messages might be consumed in batches and we would prefer to poll only one message at a time from the broker, which is the behavior we currently expect while working with the other message brokers we support. Which leads me to ask: Is there a way of determining that a Kafka consumer will poll only one message at a time? Cheers Andre
