Hi Neha, these tests were done using 100 byte messages. More information about the producer performance tests can be found here: https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#performance-numbers
The tests are indicative at best and in no way scientific, but I must say that the Kafka broker performance is impressive. Regards, Magnus 2013/11/22 Neha Narkhede <neha.narkh...@gmail.com> > Thanks for sharing this! What is the message size for the throughput > numbers stated below? > > Thanks, > Neha > On Nov 22, 2013 6:59 AM, "Magnus Edenhill" <mag...@edenhill.se> wrote: > > > This announces the 0.8.0 release of librdkafka - The Apache Kafka client > C > > library - now with 0.8 protocol support. > > > > Features: > > * Producer (~800K msgs/s) > > * Consumer (~3M msgs/s) > > * Compression (Snappy, gzip) > > * Proper failover and leader re-election support - no message is ever > lost. > > * Configuration properties compatible with official Apache Kafka. > > * Stabilized ABI-safe API > > * Mainline Debian package submitted > > * Production quality > > > > > > Home: > > https://github.com/edenhill/librdkafka > > > > Introduction and performance numbers: > > https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md > > > > Have fun. > > > > Regards, > > Magnus > > > > P.S. > > Check out Wikimedia Foundation's varnishkafka daemon for a use case - > > varnish log forwarding over Kafka: > > https://github.com/wikimedia/varnishkafka > > >
