Re: Offset question

2013-10-07 Thread Francis Dallaire
splay/KAFKA/Log+Compaction). This would leave holes between offsets for topics where you enabled compaction. -Jay On Mon, Oct 7, 2013 at 12:45 PM, Francis Dallaire < francis.dalla...@ubisoft.com> wrote: > Hi, > > I have question regarding the offset in kafka (0.8). I

Offset question

2013-10-07 Thread Francis Dallaire
Hi, I have question regarding the offset in kafka (0.8). I've gone through the documentation and did some tests, but I want to make sure I'm on the right track. * Are the offsets guaranteed to be sequential in a partition ? o Can it contain holes ? * How offsets are distrib

Re: heterogenous kafka cluster?

2013-05-17 Thread Francis Dallaire
Well if you're willing to manage the partitions by yourself, I think it would be possible. You would have to create more partitions for your topics and then assign more partitions to the new machines. If kafka was able to rebalance automaticaly, and doing this by not only considering the number

Re: Kafka performance

2013-05-16 Thread Francis Dallaire
+1 ... very good suggestion. Sent from Samsung Mobile Original message From: Stone Date: 05-17-2013 2:16 AM (GMT-05:00) To: users@kafka.apache.org Subject: Re: Kafka performance Hi Kishore, Since a message is only exposed to the consumers after it is flushed. Maybe you ca

Re: Time difference between message fetch and message send is very high (~900-1200ms)

2013-05-16 Thread Francis Dallaire
ore V. Kopalle" Date: 05-17-2013 2:11 AM (GMT-05:00) To: users@kafka.apache.org,Francis Dallaire Subject: Re: Time difference between message fetch and message send is very high (~900-1200ms) Hi Frank, Yes, they are on the same machine. Zoo Keeper, Kafka server and the KafkaConsumerProducerDemo

Re: Time difference between message fetch and message send is very high (~900-1200ms)

2013-05-16 Thread Francis Dallaire
Quick question. Are the producer and consumer on the same machine ? If not, are you accounting for any difference in the time setting between producer and consumer ? Frank Sent from Samsung Mobile Original message From: Kishore Kopalle Date: 05-17-2013 1:41 AM (GMT-05:00)

RE: mailinglist subscription

2013-04-26 Thread Francis Dallaire
The lists are managed by ezmlm, so you have to send an email to : users-subscr...@kafka.apache.org You will be added automatically. Frank