Not seeing disk writes on all replica brokers

2016-03-19 Thread Kiran Nagaraja
Hi, I'm running version kafka_2.11-0.9.0.1 in a 2 broker configuration with 10 partitions that are replicated - replication.factor=2 Here's the output from 'kafkat partitions': TopicPartitionLeaderReplicasISRs bookmarks00[0, 1]

Re: Not seeing disk writes on all replica brokers

2016-03-19 Thread Christian Posta
what exactly are you monitoring in terms of the "disk writes"? kafka writes to disk but does not fsync. so you may or may not see activity at the disk when writing; it'll be up to the OS to write back to the disk. On Wed, Mar 16, 2016 at 5:17 PM, Kiran Nagaraja wrote: > Hi, > > I'm running versi

Re: Not seeing disk writes on all replica brokers

2016-03-19 Thread Kiran Nagaraja
> > what exactly are you monitoring in terms of the "disk writes"? Looking at both bytes written and number of IOPs. I do see the batched writes activity from the OS but they seem to be missing on some replicas. I looked into the kafka log and found there is frequent change in cluster/ISR for th