Re: Help Us Nominate Apache Kafka for a 2015 Bossie (Best of OSS) Award - Due June 30th

2015-06-26 Thread Gwen Shapira
Sent! Thanks for letting us know of this opportunity to promote our favorite Apache project :) For inspiration, here's what I wrote: Apache Kafka revolutionized stream processing for big data. There is a dramatic growth in the number and variety of data sources an organization has to track as wel

Re: Kafka consumer does not work from eclipse when kafka running inside VM

2015-06-26 Thread Gwen Shapira
Zookeeper actually doesn't show any errors - it shows a warning, which is pretty normal. What does your consumer and Kafka broker show? Are there any errors in the consumer? Or is it just hanging? You may want to consult our FAQ: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whydoesmy

Kafka consumer does not work from eclipse when kafka running inside VM

2015-06-26 Thread shivam tiwari
Kafka 0.8.2.2.3 and zookeper both are running inside VM. I was able to run both producer and consumer within VM successfully using kafka-console-producer.sh and kafka-console-consumer.sh respectively. Even I was able to consume Kafka messages from host machine using kafka-console-consumer.sh. But w

Help Us Nominate Apache Kafka for a 2015 Bossie (Best of OSS) Award - Due June 30th

2015-06-26 Thread Neha Narkhede
Hello Kafka community members, We appreciate your use and support of Kafka and all the feedback you’ve provided to us along the way. If all is still going well with Kafka and you’re realizing great value from it, we’d like your support in nominating Kafka for a 2015 InfoWorld Bossie award, which

Kafka consumer does not work from eclipse when kafka running inside VM

2015-06-26 Thread shivam tiwari
Kafka 0.8.2.2.3 and zookeper both are running inside VM. I was able to run both producer and consumer within VM successfully using kafka-console-producer.sh and kafka-console-consumer.sh respectively. Even I was able to consume Kafka messages from host machine using kafka-console-consumer.sh. But w

Re: Message loss due to zookeeper ensemble doesn't work

2015-06-26 Thread noah
I think you have it backwards. If you don't write your consumer offsets, the worst case is that consumers will read some messages a second time. If your messages are idempotent, then you wont lose or corrupt any data. When the ZK cluster comes back up you can start writing offsets again. However,

Re: Message loss due to zookeeper ensemble doesn't work

2015-06-26 Thread bit1...@163.com
Can someone explain this ? Thanks! bit1...@163.com From: bit1...@163.com Date: 2015-06-25 11:57 To: users Subject: Message loss due to zookeeper ensemble doesn't work Hi, I have the offset saved in zookeeper. Because zookeeper quorum doesn't work for a short time(leader is down and new leade