Re:Announcing Confluent

2014-11-06 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Congratulations Jay, Jun and Neha. Great news. Wish you good luck!!! - Original Message - From: users@kafka.apache.org To: d...@kafka.apache.org, users@kafka.apache.org At: Nov 6 2014 13:28:51 Hey all, I’m happy to announce that Jun Rao, Neha Narkhede and I are creating a company around

Re: request.required.acks=-1 under high data volume

2014-07-30 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Thanks for the link Jun. Is there video recording for this talk? - Original Message - From: users@kafka.apache.org To: users@kafka.apache.org At: Jul 30 2014 12:44:51 Just want to send out the link that describes how replication works in Kafka, in case people are not aware of it. http://

Re: Java API to list topics and partitions

2014-05-21 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Thanks. It works. - Original Message - From: Jun Rao At: Tuesday, May 20, 2014 23:33 You can issue a TopicMetadataRequest. See  https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example Thanks, Jun On Tue, May 20, 2014 at 3:41 PM, Saurabh Agarwal (BLOOMBERG

Re: Java API to list topics and partitions

2014-05-20 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Thanks. I will look into it. - Original Message - From: Timothy Chen At: Tuesday, May 20, 2014 18:56 There is a Scala API. You can take a look at TopicCommand.scala as kafka-topics.sh simply calls that class. Tim On Tue, May 20, 2014 at 3:41 PM, Saurabh Agarwal (BLOOMBERG/ 731 LEX

Java API to list topics and partitions

2014-05-20 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Hi, Is there java API in kafka to list topics and partitions in the kafka broker? Thanks, Saurabh.

stream logs from remote servers.

2014-05-20 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
What is the best way to stream the log lines from a number of remote servers to the Kafka broker? Simple tailing does not work as these log files are rotated over the time. And if the tail process fail, the program need to start reading from the point of failure. It would be good if the tool ha

Re: performance testing data to share

2014-05-16 Thread Saurabh Agarwal (BLOOMBERG/ 731 LEX -)
Hi Bert, Thanks for sharing the perf number. Just wondering if you can share your hardware setup and broker and producer conf? are you running producer at the kafka node? we don't have an optimal setup yet, such as multiple disk drives. We are not seeing same perf number in our setup. Would li