Re: Uneven GC behavior between nodes

2016-03-07 Thread Cees de Groot
On Sat, Mar 5, 2016 at 4:35 AM, James Cheng wrote: > Your partitions are balanced, but is your data being evenly written across > all the partitions? How are you producing data? Are you producing them with > keys? Is it possible that the majority of the messages being written to > just a few part

Re: Uneven GC behavior between nodes

2016-03-05 Thread James Cheng
Your partitions are balanced, but is your data being evenly written across all the partitions? How are you producing data? Are you producing them with keys? Is it possible that the majority of the messages being written to just a few partitions, and so the brokers for those partitions are seeing

Uneven GC behavior between nodes

2016-03-04 Thread Cees de Groot
We're seeing something funny in one of our production clusters that I cannot explain away. Everything works fine, but as we're ramping up on Kafka, I really want to get at the root cause before we push a ton of traffic through it :) We have 6 nodes over three DCs in the cluster. Currently it's run