Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
Hi Team, I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup using the instructions given on the website. But when I try to start zookeper server, I am getting below error: Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain M

Re: [DISCUSS] Kafka Security Specific Features

2014-07-30 Thread Rajasekar Elango
We implemented security features on older snapshot version of 0.8 kafka. But Joe Stein's organization rebased it to latest version of kafka available at https://github.com/stealthly/kafka/tree/v0.8.2_KAFKA-1477. Thanks, Raja. On Tue, Jul 29, 2014 at 10:54 PM, Calvin Lei wrote: > Raja, >Whi

Re: request.required.acks=-1 under high data volume

2014-07-30 Thread Jun Rao
Just want to send out the link that describes how replication works in Kafka, in case people are not aware of it. http://www.slideshare.net/junrao/kafka-replication-apachecon2013 Thanks, Jun On Tue, Jul 22, 2014 at 2:06 AM, Michal Michalski < michal.michal...@boxever.com> wrote: > > Interesti

Re: request.required.acks=-1 under high data volume

2014-07-30 Thread Gwen Shapira
Super useful slide-deck. Thank you! On Wed, Jul 30, 2014 at 9:44 AM, Jun Rao wrote: > Just want to send out the link that describes how replication works in > Kafka, in case people are not aware of it. > > http://www.slideshare.net/junrao/kafka-replication-apachecon2013 > > Thanks, > > Jun > > >

Re: request.required.acks=-1 under high data volume

2014-07-30 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Thanks for the link Jun. Is there video recording for this talk? - Original Message - From: users@kafka.apache.org To: users@kafka.apache.org At: Jul 30 2014 12:44:51 Just want to send out the link that describes how replication works in Kafka, in case people are not aware of it. http://

Issues with metrics collection

2014-07-30 Thread Kiran Nagasubramanian
Hello, We're collecting the JMX metrics from the Kafka brokers. We're seeing a couple of issues. Could someone please throw some light if you've come across something similar? 1) We have a 3 broker Kafka cluster and when we're trying to collect the metrics like messages in per sec, bytes in per s

Re: [DISCUSS] Kafka Security Specific Features

2014-07-30 Thread Calvin Lei
yeah i just saw that. Looking forward to the prod release of 0.8.2 On Wed, Jul 30, 2014 at 11:01 AM, Rajasekar Elango wrote: > We implemented security features on older snapshot version of 0.8 kafka. > But Joe Stein's organization rebased it to latest version of kafka > available at https://git

Re: [DISCUSS] Kafka Security Specific Features

2014-07-30 Thread Joe Stein
The 0.8.2 release will not have the patch inside of it. Trunk already has a lot inside of it as a point release. The patch also doesn't account for all of the requirements that all of the stakeholders need/want for the feature. Instead of releasing something that is useful but only for some it i

RE: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
Hi Team, Can anyone kindly help me in this issue? Thanks, Pradeep Simha -Original Message- From: pradeep.si...@wipro.com [mailto:pradeep.si...@wipro.com] Sent: Wednesday, July 30, 2014 6:44 PM To: users@kafka.apache.org Cc: Ritwik Batabyal (WT01 - Business Outcome Services) Subject: Apac

Most common kafka client comsumer implementations?

2014-07-30 Thread Jim
Curious on a couple questions... Are most people(are you?) using the simple consumer vs the high level consumer in production? What is the common processing paradigm for maintaining a full pipeline for kafka consumers for at-least-once messaging? E.g. you pull a batch of 1000 messages and: opti

Re: request.required.acks=-1 under high data volume

2014-07-30 Thread Jun Rao
I don't think the video is available. Sorry, Jun On Wed, Jul 30, 2014 at 9:52 AM, Saurabh Agarwal (BLOOMBERG/ 731 LEX -) < sagarwal...@bloomberg.net> wrote: > Thanks for the link Jun. Is there video recording for this talk? > > - Original Message - > From: users@kafka.apache.org > To:

Re: Issue with unit testing Kafka on 0.8.1.1 and scala 2.9.2

2014-07-30 Thread Jun Rao
Perhaps you can follow some examples in Kafka unit test? Thanks, Jun On Tue, Jul 29, 2014 at 7:32 PM, Sathyanarayanan Nagarajan < sathy...@gmail.com> wrote: > Hi, > > i have been trying to run the kafka server using TestUtils.for my unit > tests, while the topic gets created, i'm getting the

Re: Issues with metrics collection

2014-07-30 Thread Jun Rao
(1) Those metrics are only reported on brokers that are the leader of some partitions. (2) Which jmx collector are you using? Thanks, Jun On Wed, Jul 30, 2014 at 1:12 PM, Kiran Nagasubramanian wrote: > Hello, > > We're collecting the JMX metrics from the Kafka brokers. We're seeing a > coupl

Re: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread Jun Rao
Is zookeeper jar in your classpath? Thanks, Jun On Wed, Jul 30, 2014 at 6:13 AM, wrote: > Hi Team, > > I just downloaded Kafka 2.8.0 from Apache website, and I am trying to > setup using the instructions given on the website. But when I try to start > zookeper server, I am getting below error

RE: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain

2014-07-30 Thread pradeep.simha
Hi, Yes I tried. Added CLASSPATH environment variable with value D:\Projects\kafka_2.8.0-0.8.1.1\libs\zookeeper-3.3.4.jar and tried to start kafka. But still I am getting same error. Thanks, Pradeep Simha Technical Lead -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: