I
> used reassignment to move the large partition onto a different set of
> machines (which forced the cleaner to run through them again) and after the
> new machines finished replicating, the partition was back down from 41GB to
> a nice trim 38MB.
>
> On Fri, Oct 28, 2016 at 1:00 PM,
Hi,
We have a 3-node cluster that is running 0.9.0.1, and recently saw that the
"__consumer_offsets" topic on one of the nodes seems really skewed with
disk usage that looks like:
73G ./__consumer_offsets-10
0 ./__consumer_offsets-7
0 ./__consumer_offsets-4
0 ./__consumer_off
We are running with a JBOD configuration, and it is not recommended for the
following reasons:
- any volume failure causes an unclean shutdown and requires lengthy
recovery
- data is not distributed consistently across volumes, so you could have
skew within a broker
We are planning to switch to a
I highly recommend https://github.com/airbnb/kafkat, which will simplify
your partition management tasks. Use it with
https://github.com/airbnb/kafkat/pull/3 for partition specific reassignment.
Chi
On Mon, Apr 13, 2015 at 4:08 AM, Jan Filipiak
wrote:
> Hey,
>
> try to not have newlines \n in
Hi Stevo,
I won't speak for Joe, but what we do is documented in the link that Joe
provided:
"Adding servers to a Kafka cluster is easy, just assign them a unique
broker id and start up Kafka on your new servers. However these new servers
will not automatically be assigned any data partitions, so u
We are using Kafka 0.8.1.1 (2.9.2) rebuilt with Snappy 1.1.0.1, and don't
have problems with producers or consumers.
Chi
On Thu, Jun 5, 2014 at 9:29 PM, Vinay Gupta
wrote:
> Hi,
> I am using
> kafka_2.9.2-0.8.1and
> snappy-java-1.1.0.1.jar
>
>
> I have been able to successfully use gzip
We've used bytes written as in, and bytes read as out.
Chi
On Mon, Mar 31, 2014 at 11:12 AM, Arnaud Lawson wrote:
> Ok thanks Guozhang . So What would the metrics for the in-traffic and
> out-traffic message count be on this page (this page shows all existing jmx
> metrics)?
>
> https://cwiki.a
