kafka 0.9.0.1: FATAL exception on startup

2016-03-08 Thread Anatoly Deyneka
Hi, I need your advice how to start server in the next situation: It fails on startup with FATAL error: [2016-03-07 16:30:53,495] FATAL Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable) kafka.common.InvalidOffsetException: Attempt to append a

data archiving

2014-06-16 Thread Anatoly Deyneka
Hi all, I'm looking for the way of archiving data. The data is hot for few days in our system. After that it can rarely be used. Speed is not so important for archive. Lets say we have kafka cluster and storage system. It would be great if kafka supported moving data to storage system instead of

Re: kafka availability

2014-04-07 Thread Anatoly Deyneka
I have found the problem - it's missconfiguration in /etc/hosts/ The current host was double defined: 127.0.1.1 kafka-broker1 192.168.25.134 kafka-broker1 Once I've removed the first entry the availability test passed. Thank you for the help. Anatoly

Re: kafka availability

2014-04-04 Thread Anatoly Deyneka
Yes, broker 0 is started. INFO conflict in /controller data: { "brokerid":0, "timestamp":"1396619945779", "version":1 } stored data: { "brokerid":1, "timestamp":"1396511882085", "version":1 } (kafka.utils.ZkUtils$) INFO [Kafka Server 0], Started (kafka.server.KafkaServer) if the problem is confli

kafka availability

2014-04-02 Thread Anatoly Deyneka
Hi, I perform availability tests on next kafka setup: - 3 nodes(2f+1) for zookeeper(zookeeper1, zookeeper2, zookeeper3) - 2 nodes(f+1) for kafka brokers(id:0,host:kafka.broker1,port:9092; id:1,host:kafka.broker2,port:9092) I use java producer and console consumer. Test stepts: 1. create topic tes