Re: java.lang.NumberFormatException: null - when producer tries to send message to Kafka queue

Which version of ZK are you using? Thanks, Jun On Thu, Jun 6, 2013 at 3:26 PM, Ashish Nigam wrote: > Hi, > I am getting exception when Producer tries to send messages to Kafka queue. > > It tries to connect to zookeeper instances and then throws exception. > Here's initial log - > > 06 Jun 20

Re: Monitor Kafka Stats

Scott, Thanks for the patch. We are getting pretty close to release 0.8 beta. Once that's out, we can take a look at the patch. Jun On Thu, Jun 6, 2013 at 9:11 AM, Scott Clasen wrote: > Hi Jun > > Have you looked at Kafka-898 in jira? > > It has a patch for reporting metrics to librato, which

Re: Arguments for Kafka over RabbitMQ ?

We also went through the same decision making and our arguments for Kafka where in the same lines as those Jonathan mentioned. The fact that we have heterogeneous consumers is really a deciding factor. Our requirements were to avoid loosing messages at all cost while having multiple consumers readi

java.lang.NumberFormatException: null - when producer tries to send message to Kafka queue

Hi, I am getting exception when Producer tries to send messages to Kafka queue. It tries to connect to zookeeper instances and then throws exception. Here's initial log - 06 Jun 2013 15:17:29,541 [DEBUG] ZkConnection | Creating new ZookKeeper instance to connect to 172.16.1.104:2181

Postie - Kafka Consumer Framework

Hi all! This excellent presentation on StumbleUpon's implementation of Kafka and other Open Source technologies mentions 'Postie' as a 'Kafka Consumer Framework': http://strataconf.com/strata2013/public/schedule/detail/27419 Can anyone share some more details on this?  Relentless Googling has be

Re: Arguments for Kafka over RabbitMQ ?

We just went through a similar exercise with RabbitMQ at our company with streaming activity data from our various web properties. Our use case requires consumption of this stream by many heterogeneous consumers including batch (Hadoop) and real-time (Storm). We pointed out that Kafka acts as a c

Re: package error

hey Balaji, thanks of the help. I tried: ./sbt "++2.8.0 package" and it still failed. So I tried: ./sbt "++2.9.2 package" and it worked! Does anyone have an idea why the 2.8.0 failed and what could I do to target scala 2.8? thanks, rob On Jun 6, 2013, at 11:57 AM, "Seshadri,

Arguments for Kafka over RabbitMQ ?

Hi -- I am preparing to make a case for using Kafka instead of Rabbit MQ as a broker-based messaging provider. The context is similar to that of the Kafka papers and user stories: the producers publish monitoring data and logs, and a suite of subscribers consume this data (some store it, others

RE: package error

Try ./sbt "++2.8.0 package". -Original Message- From: Rob Withers [mailto:reefed...@gmail.com] Sent: Thursday, June 06, 2013 11:54 AM To: kafka list Subject: package error I am quite unfamiliar with compiling with sbt package. What could be my issue here? It seems like the scala libra

package error

I am quite unfamiliar with compiling with sbt package. What could be my issue here? It seems like the scala library is wrong, but where do I look for the scala jar? thanks, rob "$ ./sbt package [info] Loading project definition from /Users/reefedjib/Desktop/rob/comp/workspace/kafka/project

Re: bug report

That's interesting. The issue is that we somehow are missing a response for [libomirror8,3] specified in the request. I don't know how this is happening in the broker though. Are you using the latest code in the 0.8 branch? Incomplete response (ProducerResponse(334159,Map([libomirror8,9] -> Produ

Re: Monitor Kafka Stats

Hi Jun Have you looked at Kafka-898 in jira? It has a patch for reporting metrics to librato, which would make it very easy for people to get started with Kafka metrics. Sent from my iPhone On Jun 6, 2013, at 8:55 AM, Jun Rao wrote: > Those stats on the broker are available through JMX. In 0

Re: Monitor Kafka Stats

Those stats on the broker are available through JMX. In 0.8, since we use metrics, you can potentially use different reporters to get the stats (see http://metrics.codahale.com/getting-started/#reporting-via-http). Thanks, Jun On Thu, Jun 6, 2013 at 4:50 AM, Hanish Bansal < hanish.bansal.agar..

bug report

The publisher tried to publish 10G data (msg size 10k) to 3 brokers. This error occurred so frequently and caused big delay. [2013-06-06 11:13:29,491] INFO Shutting down producer (kafka.producer.Producer) [2013-06-06 11:13:29,492] INFO Beging shutting down ProducerSendThread (kafka.producer.async

Monitor Kafka Stats

Hi I am trying to get some parameters from kafka like Data produced per second, Data Consumed per second etc. There is a java api in Kafka "kafka.network.SocketServerStats" that i am using for my purpose : socketServerStats.getNumProduceRequests()); socketServerStats.getNumFetchRequests(); socke