Re: kafka monitoring system

2014-12-22 Thread chetan conikee
Try SemaText : a fully managed monitoring SaaS : http://sematext.com/ ... On Mon, Dec 22, 2014 at 7:46 PM, Rajasekar Elango wrote: > Hi Sa Li, > > You can also try jmxtrans + graphite (for charting). jmxtrans has graphite > output adapter out of the box. > > Regards, > Raja. > > On Mon, Dec 22,

Re: Announcing Confluent

2014-11-06 Thread chetan conikee
Congrats Jay, Neha and Jun. Look forward to it. On Thu, Nov 6, 2014 at 10:28 AM, Jay Kreps wrote: > Hey all, > > I’m happy to announce that Jun Rao, Neha Narkhede and I are creating a > company around Kafka called Confluent. We are planning on productizing the > kind of Kafka-based real-time dat

Re: programmatically get number of items in topic/partition

2014-10-01 Thread chetan conikee
The other method is via command line bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group *groupName* --zkconnect *zkServer:2181* Refer : https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-ConsumerOffsetChecker https://apache.googlesource.com/kafka/+/0.8.0-bet

Re: Anyone working on a Kafka book?

2013-12-10 Thread chetan conikee
Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > I'll let chetan comment if he's up for it. > -Steve > > > > On Tue, Dec 10

Re: Adding Kafka dependencies in Play Framework

2013-11-25 Thread chetan conikee
Add the following to a Play Project with Scala 2.9.2 scalaVersion := "2.9.2" libraryDependencies ++= Seq( "joda-time" % "joda-time" % "2.2", "org.joda" % "joda-convert" % "1.3.1", "ch.qos.logback" % "logback-classic" % "1.0.13", "org.mashupbots.socko" % "socko-webserver_2.9.2" % "0.2

Re: Using Kafka 0.8 from Scala and Akka

2013-10-31 Thread chetan conikee
I am in the process of releasing out Scala and RxJava consumer(s) on github. Will be releasing it soon. Keep an eye out. On Thu, Oct 31, 2013 at 3:49 PM, Richard Rodseth wrote: > So I have the 0.8. Beta 1 consumer Java example running now. > > Is there a Scala API documented somewhere? What abo

Re: Plan for Scala 2.10+ support

2013-10-29 Thread chetan conikee
*/ > > > On Tue, Oct 29, 2013 at 11:43 PM, Aniket Bhatnagar < > aniket.bhatna...@gmail.com> wrote: > >> I haven't been able to find one which we why had to build Kafka 0.8 from >> source. It's not super hard though to build Kafka. >> >>

Re: Plan for Scala 2.10+ support

2013-10-29 Thread chetan conikee
Are there any public maven repos hosting 0.8 with 2.10+ support.? Sent from my iPhone > On Oct 29, 2013, at 8:32 PM, Aniket Bhatnagar > wrote: > > The latest 0.8 branch has support for scala 2.10. We use it in our > projects. Once 0.8 is released, I believe you should be able to see 2.10 > ar

Re: Producer not distributing across all partitions

2013-09-14 Thread chetan conikee
Swapnil What do you mean by "I did a local test today that showed that choosing DefaultPartitioner with null key in the messages appended data to multiple partitions"? Are messages being duplicated across partitions? -Chetan On Sat, Sep 14, 2013 at 9:02 PM, Swapnil Ghike wrote: > Hi Joe, Dre

Re: Producer not distributing across all partitions

2013-09-14 Thread chetan conikee
Prashant I recall you mentioning that you are on the 0.8 branch .. If so, can you check your producer to verify if you are using DefaultParitioner, SimplePartitioner or null (which defaults to RandomParitioner)? *kafkaProps.put("partitioner.class", "kafka.producer.DefaultPartitioner") * Also ,

Re: Producer not distributing across all partitions

2013-09-13 Thread chetan conikee
I am using kafka 0.8.0-beta1 .. Seems like messages are being delivered only to one partition (since installation) Should I upgrade or apply a patch to mitigate this issue. Please advice On Thu, Sep 12, 2013 at 8:44 PM, Jun Rao wrote: > Which revision of 0.8 are you using? In a recent change

Re: Loadbalancing producers

2013-08-29 Thread chetan conikee
As Benjamin indicated, you wouldn't get much out of an LB in front of brokers, especially if the producers are configured in async mode (which you would want to in order to increase throughput). On Thu, Aug 29, 2013 at 8:54 AM, Mark wrote: > Can you explain why not? > > On Aug 29, 2013, at 8:4

Re: 0.8.0-beta1 is now available in public maven

2013-07-15 Thread chetan conikee
I stumbled on a few issues when I was attempting to create a Scala based Client (Producer/Consumer) project. Finally worked after revisions: Here's the snippet of by build.sbt ~~ /* scala versions and options */ scalaVersion := "2.9.2" libraryDependencies += "org.apache.kafka" %

Re: 0.8.0-beta1 is now available in public maven

2013-07-14 Thread chetan conikee
Excellent What about the resolver ? sonatype, typeafe. maven artifactory ? Any plans for a 2.10+ compile as well On Sun, Jul 14, 2013 at 6:37 PM, Dima Gutzeit wrote: > What about the "newer" (not so new anymore) scala version 2.10.0 and up ? > When will it be supported officially ? > > > Regar

Kafka distribution on public Maven repo

2013-07-12 Thread chetan conikee
Hey Jay This question might have been posed a million times, but thought I might pose it again. Why has kafka not been published to a public Maven repo? Chetan

Re: S3 Consumer

2012-12-28 Thread Chetan Conikee
Noticed this s3 based consumer project on github https://github.com/razvan/kafka-s3-consumer On Dec 27, 2012, at 7:08 AM, David Arthur wrote: > I don't think anything exists like this in Kafka (or contrib), but it would > be a useful addition! Personally, I have written this exact thing at p