Re: Kafka producer perf script throw java.io.IOException

2015-02-09 Thread Xinyi Su
Hi, Jun I create a Jira issue to track it. Please have a look at it. https://issues.apache.org/jira/browse/KAFKA-1939 Thanks. Xinyi On 10 February 2015 at 10:38, Jun Rao wrote: > The new producer uses a different built-in metrics package. Currently, it > only supports a jmx reporter for the me

Re: Kafka producer perf script throw java.io.IOException

2015-02-09 Thread Jun Rao
The new producer uses a different built-in metrics package. Currently, it only supports a jmx reporter for the metrics. So you will have to get the metrics from jmx. We can add the csv reporter in ProducerPerformance for the new producer by using the new metrics api. Could you file a jira for that

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
Hi, You are right. The file is created by Kafka and Kafka producer csv reporter append metrics continuously during perf test. It should not be created continuously during test but create once only. Another thing is when I turn on "--new-producer" and "--sync" option, nothing is appended into Pro

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Jaikiran Pai
>> java.io.IOException: Unable to create /tmp/PerfTopic22_1/ProducerRequestSize.csv It looks like a file with that exact same name already exists which is causing that file creation request to fail. This indicates that probably the metric name (ProducerRequestSize) from which the file is creat

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
Hi, I need to get more metrics from csv reporter. If turn off csv-reporter, few output is shown. Thanks. Xinyi On 5 February 2015 at 13:09, tao xiao wrote: > Hi, > > In order to get it work you can turn off csv-reporter. > > On Thu, Feb 5, 2015 at 1:06 PM, Xinyi Su wrote: > > > Hi, > > > > T

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread tao xiao
Hi, In order to get it work you can turn off csv-reporter. On Thu, Feb 5, 2015 at 1:06 PM, Xinyi Su wrote: > Hi, > > Today I updated Kafka cluster from 0.8.2-beta to 0.8.2.0 and run kafka > producer performance test. > > The test cannot continue because of some exceptions thrown which does not

Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
Hi, Today I updated Kafka cluster from 0.8.2-beta to 0.8.2.0 and run kafka producer performance test. The test cannot continue because of some exceptions thrown which does not occur at 0.8.2-beta. My perf library is kafka-perf_2.9.2-0.8.0.jar which is the latest version on maven repository. -bas