Best kafka performance is with messages size in the order of a few KB. Larger messages put heavy load on brokers and is very inefficient. It is inefficient on producers and consumers as well
regards On Thu, Sep 6, 2018 at 11:16 PM SenthilKumar K <senthilec...@gmail.com> wrote: > Hello Experts, We are planning to use Kafka for large message set ( size > various from 2 MB to 4 MB per event ). By setting message.max.bytes to 64 > MB value this Kafka Producer allows large messages. But how does it > impacts performance (both producer and consumer)? > > Would like to understand the performance impact of different message size > . Example : producing 50KB vs 1MB . > > What is the optimal message size can be used in Kafka Producer ? > > --Senthil > -- http://khangaonkar.blogspot.com/
