I am doing some performance tests on Apache Kafka to compare it with
others like RabbitMQ and ActiveMQ. The idea is to use it on a messaging
system for agents' communication.
I am testing multiple scenarios (one to one, broadcast and many to one)
with different numbers of publishers and subscribers and so different
loads. Even in the lowest load scenario of one to one with 10 pairs of
agents sending 500 messages with 1ms delay between sends I am
experiencing very high latencies (average of ~200ms). And if we go to
100 pairs the numbers rise to ~1500ms. The same thing happens on
broadcast and many to one.
I am using Windows with Kafka 2.12-2.5.0 and zookeeper 3.6.1 with C#
.Net client Confluent.Kafka 1.4.2.
I have already tried some properties like LingerMs = 0 according to some
posts I found. I have both Kafka and zookeeper with default settings.
The code I am using is available at https://pastebin.com/Cw57p7e0
Does someone what can be the problem? What configs can I change to
improve latency?
Thanks,
Davide Costa
