Stuck replicas after reassign-partitions in kafka 0.9

Topic: events Partition: 6 Leader: 21 Replicas: 25,21,9,17,22,3 Isr: 21,17,25 Topic: events Partition: 7 Leader: 20 Replicas: 5,20,9 Isr: 20,5,9 We have some replicas in our topic which are extras. (topic replication factor is 3).Tried to do kafka-reassign-partition.sh by removing the non-sync

Kafka 0.9.0.1 Direct buffer memory OOM

Hi Kafka Users, We are using kafka 0.9.0.1 and frequently we have seen below exception which causes the broker to die.We even increased the MaxDirectMemory to 1G but still see this.  2017-02-16 00:55:57,750] ERROR Processor got uncaught exception. (kafka.network.Processor) java.lang.OutOfMemoryE

Trouble with snappy and SimpleConsumer

Hi, I am using kafka_2.9.2-0.8.1and snappy-java-1.1.0.1.jar I have been able to successfully use gzip with the same library. however “snappy” doesn’t work in consumer side. Producer is able to send snappy messages to broker though. I have made sure that snappy java lib is the same on both

Unit testing with Kafka

Are there unit testing libs in kafka which we can include to test our producers/consumers?? I found the following but the maven libs mentioned there seem to be missing. http://grokbase.com/t/kafka/users/13ck94p302/writing-unit-tests-for-kafka-code Any one else tackled this issue? Thanks, -Vin