Re: KafkaException: Should not set log end offset on partition

2014-12-04 Thread svante karlsson
Thanks, kind of obvious afterwards :-). I used ip addresses in my ansible configuration so everything else worked. 2 -> {"jmx_port":13005,"timestamp":"1417702658359","host":"ubuntu","version":1,"port":9092}... 4 -> {"jmx_port":13005,"timestamp":"1417698861869","host":"ubuntu","version":1,"port":90

Re: KafkaException: Should not set log end offset on partition

2014-12-04 Thread Jun Rao
Could you look at the broker registration in Zookeeper ( https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper) and make sure the 3 registered hosts are unique? Thanks, Jun On Wed, Dec 3, 2014 at 5:54 AM, svante karlsson wrote: > I've installed (for ansible scrip

Re: KafkaException: Should not set log end offset on partition

2014-12-03 Thread svante karlsson
I found some logs like this before everything started to go wrong ... [2014-12-02 07:08:11,722] WARN Partition [test3,13] on broker 2: No checkpointed highwatermark is found for partition [test3,7] (kafka.cluster.Partition) [2014-12-02 07:08:11,722] WARN Partition [test3,7] on broker 2: No checkpo

KafkaException: Should not set log end offset on partition

2014-12-03 Thread svante karlsson
I've installed (for ansible scripting testing purposes) 3 VM's each containing kafka & zookeeer clustered together Ubuntu 14.04 Zookeepers are 3.4.6 and kafka 2.11-0.8.2-beta The kafka servers have broker id's 2, 4, 6 The zookeepers seems happy. The kafka servers start up and seems happy. I can