Failing broker with errors for Conditional update

2014-04-03 Thread Krzysztof Ociepa
Hi Team, I test Kafka 0.8.1 and have problems with missing brokers. What I did: 1. Installed Zookeeper 3.3.6 servers on 3 dedicated machines 2. Installed Kafka 0.8.1 brokers on 3 machines (different from Zookeeper ones) 3. Configured brokers as above: # Replication configurations num.replica.fetc

Re: Failing broker with errors for Conditional update

2014-04-03 Thread Guozhang Wang
Hi Chris, >From the logs it seems your controller machine id=2 has some soft failure, such as a long GC which casued it to session timeout from ZK. Then when it is shutting down it hits a known bug (related to KAFKA-1311) in 0.8.1 which will cause it to hang on controller shutdown. We are currentl

DefaultEventHandler's getPartition's return value

2014-04-03 Thread joe smith
Hi, My apologies - a newbie here. In looking at the getPartition() method, I notice the returned value for keyed message is the "index" of a partition.  But when there is no key, then the value returned is the "id" of a partition.   case None =>     val availablePartitions = t

Re: Controlled shutdown and leader election issues

2014-04-03 Thread Clark Breyman
Thank Neha - Is there a maven repo for pulling snapshot CI builds from? Sorry if this is answered elsewhere. On Wed, Apr 2, 2014 at 7:16 PM, Neha Narkhede wrote: > I'm not so sure if I know the issue you are running into but we fixed a few > bugs with similar symptoms and the fixes are on the 0.

Re: DefaultEventHandler's getPartition's return value

2014-04-03 Thread Jun Rao
Yes, it's not very intuitive. Currently, it is true that we don't have gap in the partition ids. Since we already build the new producer, we probably don't have to patch the old producer. Thanks, Jun On Thu, Apr 3, 2014 at 9:06 AM, joe smith wrote: > Hi, > > My apologies - a newbie here. > >

Re: Controlled shutdown and leader election issues

2014-04-03 Thread Neha Narkhede
>> Is there a maven repo for pulling snapshot CI builds from? We still need to get the CI build setup going, could you please file a JIRA for this? Meanwhile, you will have to just build the code yourself for now, unfortunately. Thanks, Neha On Thu, Apr 3, 2014 at 12:01 PM, Clark Breyman wrote

Re: Failing broker with errors for Conditional update

2014-04-03 Thread Neha Narkhede
Hey Chris, Guozhang's analysis is worth testing. Would you mind grabbing the latest 0.8.1 branch build to re-run your test against? Thanks, Neha On Thu, Apr 3, 2014 at 8:35 AM, Guozhang Wang wrote: > Hi Chris, > > From the logs it seems your controller machine id=2 has some soft failure, > su

Re: Controlled shutdown and leader election issues

2014-04-03 Thread Clark Breyman
Done. https://issues.apache.org/jira/browse/KAFKA-1360 On Thu, Apr 3, 2014 at 9:13 PM, Neha Narkhede wrote: > >> Is there a maven repo for pulling snapshot CI builds from? > > We still need to get the CI build setup going, could you please file a JIRA > for this? > Meanwhile, you will have to ju

Re: Failing broker with errors for Conditional update

2014-04-03 Thread Krzysztof Ociepa
Hi Guozhang, Hi Neha, Thanks a lot for your answers. I will try new version 0.8.1.1 and let you know how it works for me. Best, Chris