RE: Kafka bottleneck issue

[Aditya Auradkar]

Do you have a single producer thread? Also, how do you calculate the TPS (is it 
transactions per second?) ? 

Aditya

________________________________________
From: Hawin Jiang [hawin.ji...@gmail.com]
Sent: Thursday, July 02, 2015 5:58 PM
To: users@kafka.apache.org
Subject: Kafka bottleneck issue

Hi Admin

I have executed a performance test on one single node.The TPS never over
4000 events per sec on one producer.Please help me.
Thanks in advance.


Here is my code and configuration

*********************Producer code***************************************
public void run() {
    int messageNo = 1;
    while(true)
    {
      String messageStr = new String("Message_" + messageNo);
      producer.send(new KeyedMessage<Integer, String>(topic, messageStr));
      messageNo++;
    }
  }


************************server.properties***********************************
broker.id=1
port=9092
host.name=192.168.0.112
num.network.threads=8
num.io.threads=8
socket.send.buffer.bytes=1048576
socket.receive.buffer.bytes=1048576
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
#log.flush.interval.ms=1000
log.retention.hours=168
#log.retention.bytes=1073741824
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
log.cleaner.enable=false
zookeeper.connect=192.168.0.112:2181
zookeeper.connection.timeout.ms=6000
zookeeper.properties
***************************************************************************************


*************************************
zookeeper.properties***************************
dataDir=/tmp/zookeeper
clientPort=2181
maxClientCnxns=0
****************************************************************************************




Best regards
Hawin