create topic does not really executed successfully

2015-02-02 Thread Xinyi Su
Hi, I am using Kafka_2.9.2-0.8.2-beta. When I use kafka-topic.sh to create topic, I observed sometimes the topic is not really created successfully as the output shows in console. Below is my command line: # bin/kafka-topics.sh --zookeeper :2181 --create --topic zerg.hydra --partitions 3 --rep

subscribe email

2015-02-02 Thread Xinyi Su

Re: create topic does not really executed successfully

2015-02-02 Thread Xinyi Su
ther common issue is that you specify replication-factor 3 when you > have fewer than 3 brokers. > > Gwen > > On Mon, Feb 2, 2015 at 2:34 AM, Xinyi Su wrote: > > Hi, > > > > I am using Kafka_2.9.2-0.8.2-beta. When I use kafka-topic.sh to create > > topic, I

Re: create topic does not really executed successfully

2015-02-02 Thread Xinyi Su
create > topic dirs. Apart from this make sure you point to a different > dir other than /tmp/kafka-logs since this dir gets delete when > your machine restarts and not a place to store your topic data. > -Harsha > > On Mon, Feb 2, 2015, at 07:03 PM

Kafka long tail latency issue

2015-02-03 Thread Xinyi Su
Hi, I am building Kafka cluster and run producer perf test to get Kafka latency performance. >From test result, I notice that the long tail latency is very high and increased with time passing by although the 99.9% result looks very good. The worst latency can reach more than 1 second. Besides, dis

Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
Hi, Today I updated Kafka cluster from 0.8.2-beta to 0.8.2.0 and run kafka producer performance test. The test cannot continue because of some exceptions thrown which does not occur at 0.8.2-beta. My perf library is kafka-perf_2.9.2-0.8.0.jar which is the latest version on maven repository. -bas

Re: create topic does not really executed successfully

2015-02-04 Thread Xinyi Su
Yeah, I will upgrade to 0.8.2.0 and try again. On 4 February 2015 at 13:41, Jun Rao wrote: > Could you try the 0.8.2.0 release? We did fix an issue (KAFKA-1738) that > could fail the topic creation. > > Thanks, > > Jun > > On Mon, Feb 2, 2015 at 7:03 PM, Xinyi Su wrote:

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
Hi, I need to get more metrics from csv reporter. If turn off csv-reporter, few output is shown. Thanks. Xinyi On 5 February 2015 at 13:09, tao xiao wrote: > Hi, > > In order to get it work you can turn off csv-reporter. > > On Thu, Feb 5, 2015 at 1:06 PM, Xinyi Su

Re: Kafka producer perf script throw java.io.IOException

2015-02-04 Thread Xinyi Su
ize.csv > > It looks like a file with that exact same name already exists which is > causing that file creation request to fail. This indicates that probably > the metric name (ProducerRequestSize) from which the file is created, is > duplicate for whatever reason. > > -Jaikiran

Not found NewShinyProducer sync performance metrics

2015-02-05 Thread Xinyi Su
Hi, I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync* performance. I have not found any CSV output or metrics collector for NewShinyProducer sync performance. Would you like to share with me about how to collect NewShinyProducer metrics? Thanks. Best regards. Xinyi

Re: Not found NewShinyProducer sync performance metrics

2015-02-05 Thread Xinyi Su
gt; using jmx. Any jmx monitoring tool (jconsole) can be used for monitoring. > > On Feb 5, 2015 3:56 PM, "Xinyi Su" wrote: > > > > > Hi, > > > I am using kafka-producer-perf-test.sh to study NewShinyProducer *sync* > > > performance. > > >

Kafka broker core dump

2015-02-05 Thread Xinyi Su
Hi, I encounter a Kafka broker core dump today. One broker process is aborted during test. I have attached core dump file. Kafka version I deploy is 2.9.2-0.8.2.0. Thanks. Best regards. Xinyi

Re: Kafka producer perf script throw java.io.IOException

2015-02-09 Thread Xinyi Su
or the metrics. So you will have to get the > metrics from jmx. > > We can add the csv reporter in ProducerPerformance for the new producer by > using the new metrics api. Could you file a jira for that? > > Thanks, > > Jun > > On Wed, Feb 4, 2015 at 11:48 PM, Xinyi