Which Kafka Consumer should I use?

I want to rebuild my message queue from based on Redis to Kafka (because Redis persistence is terrible). Now I am using the new KafkaProducer, and I am wondering which consumer should I use. Currently there are 3 Kafka Consumers (until 0.8.2.1): 1. High Level Consumer 2. Simple Consumer 3. Kaf

How to correctly handle offsets?

Hi all: I am using Kafka 0.8.2 and SimpleConsumer in maven: org.apache.kafka kafka_2.11 0.8.2.1 I follow the SimpleConsumer example in the wiki, and there are some questions: 1. There seems lacking of how to commit the offset to Kafka. As far as I google it, it seems that I shoul

Re: Using SimpleConsumer to get messages from offset until now

I think the SimpleConsumer Example(https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example ) in the wiki is a very good starting point. You can pass in the offset to the FetchRequest. And you

How to specify kafka bootstrap jvm options?

I want to tune the kafka jvm options, but nowhere can I pass the options to the kafka startup script(bin/kafka-server-start.sh). How to pass in the jvm options?

How to achieve Failover or HighAvailable in SimpleConsumer?

Hi all: The failover or re-balancing support seems only exist in High Level Consumer. But we have some special considerations that we have to go with the SimpleConsumer. I googled the problem but there are no answers. When the SimpleConsumer went down(due to some hardware errors or others unex

Re: Origin of product name Kafka

I just found the answer in Quora: http://www.quora.com/What-is-the-relation-between-Kafka-the-writer-and-Apache-Kafka-the-distributed-messaging-system > 在 2015年7月6日，下午8:30，jakob.vollenwei...@bkw.ch 写道： > > Hi Admin, > > I'm just wondering from where the product name Kafka originated, particular