Re: High level consumer Blocked when there is still message in topic

2013-11-12 Thread Jun Rao
What's the max lag (reported in JMX) in the consumer? Can the consumer keep up with the incoming data rate? Thanks, Jun On Tue, Nov 12, 2013 at 7:19 PM, 李帅 wrote: > Hi, > >I use Kafka 0.8 high level consumer reads message from topic > stream, 3 replica and 10 paritions. > >When I use

High level consumer Blocked when there is still message in topic

2013-11-12 Thread 李帅
Hi, I use Kafka 0.8 high level consumer reads message from topic stream, 3 replica and 10 paritions. When I use 10 threads read the stream and runing for some time (one hour or one day), some threads block at m_stream.iterator().hasNext(), but the parition still has lots of messages. I

Re: pom warning

2013-11-12 Thread Joe Stein
Hi Siyuan, we have a fix for this in 0.8.0 which is in progress being released. If you find the pom breaking for any reason (some build systems have problems with the bad pom) you can use the direct apache repository https://repository.apache.org/content/groups/public/ which has a fixed pom for 0.

pom warning

2013-11-12 Thread hsy...@gmail.com
Hi guys, When I built my project using maven I got WARNING [WARNING] The POM for org.apache.kafka:kafka_2.8.0:jar:0.8.0-beta1 is invalid, transitive dependencies (if any) will not be available: 1 problem was encountered while building the effective model And I looked at the kafka_2.8.0-0.8.0-bet

Re: Failed to produce message from the second producer

2013-11-12 Thread Jun Rao
Any error in kafka controller and state-change logs? Thanks, Jun On Mon, Nov 11, 2013 at 10:39 PM, ji yan wrote: > @Priya, I have two brokers, each running on each of two machines. The > producer broker-list is pointing to the broker server on the same machine > as the producer. > > @Jun, I c