I've been looking at the new consumer api outlined here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design
One issue in the current high-level consumer, is that it does not do a good job of distributing a set of topics between multiple consumers, unless each topic has multiple partitions. This has always seemed strange to me, since at the end of the day, even for single partition topics, the basic unit of consumption is still at the partition level (so you'd expect rebalancing to try to evenly distribute partitions (regardless of the topic)). It's not clearly spelled out in the new consumer api wiki, so I'll just ask, will this issue be addressed in the new api? I think I've asked this before, but I wanted to go check again, and am not seeing this explicitly addressed in the design. Thanks Jason
