kafka 0.8.1.1 delay in replica data

i set a topic retention.ms as 36;and then i find the replica data is delay. What could cause this? as follows screenshot: master broker: replica broker: Thanks， Lax

RE: kafka 0.8.1.1 delay in replica data

topic: Topic_test_data_1-10 leader broker data info: -rw-rw-r-- 1 mqq mqq237728 Dec 23 19:51 000211076304.index -rw-rw-r-- 1 mqq mqq 536875106 Dec 23 19:51 000211076304.log -rw-rw-r-- 1 mqq mqq237632 Dec 23 19:45 000203797807.index -rw-rw-r-- 1 mqq mqq 536879703

RE: kafka 0.8.1.1 delay in replica data

Thanks, > > Jun > > On Tue, Dec 23, 2014 at 5:23 AM, chenlax wrote: > > > topic: > > > > Topic_test_data_1-10 > > > > leader broker data info: > >-rw-rw-r-- 1 mqq mqq237728 Dec 23 19:51 000211076304.index > > -rw-rw-r-- 1

The message would be committed if message "un-committed"

as the kafka doc " Only committed messages are ever given out to the consumer. ". if followers does not copy the message on time and followers are in ISR, consumers would consume the message from leader broker? Thanks， Lax

The message would be consumed if message "un-committed"

as the kafka doc " Only committed messages are ever given out to the consumer. ". if followers does not copy the message on time and followers are in ISR, consumers would consume the message from leader broker? Thanks， Lax

RE: The message would be consumed if message "un-committed"

> Only Committed messages are made available to the consumer. The consumer > will always read from the leader. The message is said to be committed (The > high water mark is advanced) only when all the replicas in the ISR have > received it. > > Thanks, > > Mayuresh &g

RE: The message would be consumed if message "un-committed"

ect: RE: The message would be consumed if message "un-committed" > Date: Thu, 8 Jan 2015 17:47:35 + > > The consumer can only read up to leader High water mark. > > Thanks, > > Mayuresh > ________ > From: chenlax [lax...@hotmai

Error while moving some partitions to OnlinePartition state

first,i increase some partitions for a topic,and is ok, then i do kafka-reassign-partitions.sh ,and it speed long times to replicated data, and a partition status as "partition: 68 leader: 5 replicas: 8,0,5,1 isr: 5,1" so i do kafka-preferred-replica-election.sh & kafka-reassign-par

leader update partitions fail with KeeperErrorCode = BadVersion,kafka version=0.8.1.1

kafka version =0.8.1.1 i get the error log as follow: INFO Partition [Topic_Beacon_1,10] on broker 4: Shrinking ISR for partition [Topic_Beacon_1,10] from 4,7 to 4 (kafka.cluster.Partition) ERROR Conditional update of path /brokers/topics/Topic_Beacon_1/partitions/10/state with data {"control

RE: leader update partitions fail with KeeperErrorCode = BadVersion,kafka version=0.8.1.1

n', but I'm not 100% sure. But I did see lots of those same error > messages: "Cached zkVersion [X] not equal to that in zookeeper, skip > updating ISR...". > > So, I don't know that the issue was fixed in 0.8.1.1. > > Can you describe the circumstances

RE: How recover leader when broker restart

use preferred tool can rebalance leadership,but if the isr are null then the leader is only -1,how i can recover the leader. Thanks， Lax > Date: Mon, 7 Jul 2014 08:06:16 -0700 > Subject: Re: How recover leader when broker restart > From: wangg...@gmail.com > To: users@kafka.apache.org > > You

RE: How recover leader when broker restart

users@kafka.apache.org > > Lax, > > Under that scenario you would better first fix the issue of isr==null by > checking if anything went wrong on the brokers. > > Guozhang > > > On Mon, Jul 7, 2014 at 8:43 PM, chenlax wrote: > > > use preferred tool can reb

read message use SimpleConsumer,can not start with assign offset

kafka version is 0.8.0, the code as https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example when i assign a offset ,it will throw java.lang.ArrayIndexOutOfBoundsException: 0 java.lang.ArrayIndexOutOfBoundsException: 0 at com.chen.test.consumer.SimpleConsumerClie

RE: read message use SimpleConsumer,can not start with assign offset

mer,can not start with assign offset > From: jun...@gmail.com > To: users@kafka.apache.org > > What's code in line 164 of SimpleConsumerClient.getLastOffset()? > > Thanks, > > Jun > > > On Fri, Aug 22, 2014 at 7:36 AM, chenlax wrote: > > > kafka

RE: read message use SimpleConsumer,can not start with assign offset

..@gmail.com > To: users@kafka.apache.org > > Is line 64 "return offsets[0]"? What value did you pass into whichTime? > > Thanks, > > Jun > > > On Sun, Aug 24, 2014 at 7:24 PM, chenlax wrote: > > > the method getLastOffset as follow: > > >

RE: read message use SimpleConsumer,can not start with assign offset

onsumer,can not start with assign offset > From: jun...@gmail.com > To: users@kafka.apache.org > > If you want to get the latest offset, whichTime should be set to -1. > > Thanks, > > Jun > > > On Sun, Aug 24, 2014 at 8:16 PM, chenlax wrote: > > > ye

RE: read message use SimpleConsumer,can not start with assign offset

If you want to get the latest offset, whichTime should be set to -1. > > Thanks, > > Jun > > > On Sun, Aug 24, 2014 at 8:16 PM, chenlax wrote: > > > yes, it's "return offsets[0]".whichTime is a long num, is message offset i > > cached,and the kaf