Producer performance also depends on disk I/O. You can try tuning batch.size, compression.type configs. also, add more partitions for more throughput.
Useful presentation: https://www.slideshare.net/JiangjieQin/producer-performance-tuning-for-apache-kafka-63147600 On Sat, Apr 1, 2017 at 10:55 PM, Archie <anubhavnidhi1...@gmail.com> wrote: > I have set up my kafka cluster in a network with 9.3 Gbps links. And am > using the bin/kafka-producer-perf-test.sh script to test the throughput > performance of kafka for a topic which has 1 partition. > > Right now I am only able to use 1.4 Gbps of network link, i.e. the script > returns a throughput of 1.4 Gbps (179 MBps) > > My basic question is how can I increase the throughput of kafka to > completely saturate the network? > > Thanks, > Archie >
