On Sat, Mar 5, 2016 at 4:35 AM, James Cheng <jch...@tivo.com> wrote:
> Your partitions are balanced, but is your data being evenly written across > all the partitions? How are you producing data? Are you producing them with > keys? Is it possible that the majority of the messages being written to > just a few partitions, and so the brokers for those partitions are seeing > more load than the others? > > The topics are <String,String> where the keys are v4 UUIDS (random). So balancing of messages across partitions should be near-perfect, and checking consumer offsets shows that too (using kafka.admin.ConsumerGroupCommand).