Something i do not understand about this perf-test tool. 1. The legend shows 5 columns but the data shows 6 columns. I am assuming the 0 column is the one that is throwing everything off?
2. does nMsg.sec = number of message consumed per second? [bin]$ sudo ./kafka-consumer-perf-test.sh --group benchmark_indexers --compression-codec 2 --broker-list ip:9092 --new-consumer --zookeeper ip:2181 --messages 50000000000 --topic manualBenchmark1 --threads 1 --show-detailed-stats --from-latest time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec 2016-02-22 23:13:21:539, 0, 95.3674, 96.1365, 5000, 5040.3226 2016-02-22 23:13:21:821, 0, 190.7349, 362.6138, 10000, 19011.4068 2016-02-22 23:13:22:089, 0, 286.1023, 355.8486, 15000, 18656.7164 2016-02-22 23:13:22:312, 0, 381.4697, 427.6566, 20000, 22421.5247 2016-02-22 23:13:22:524, 0, 476.8372, 451.9783, 25000, 23696.6825 2016-02-22 23:13:22:735, 0, 572.2046, 454.1306, 30000, 23809.5238 2016-02-22 23:13:22:907, 0, 667.5720, 554.4618, 35000, 29069.7674 2016-02-22 23:13:23:115, 0, 762.9395, 458.4973, 40000, 24038.4615 2016-02-22 23:13:23:326, 0, 858.3069, 454.1306, 45000, 23809.5238 2016-02-22 23:13:23:579, 0, 953.6743, 378.4422, 50000, 19841.2698 2016-02-22 23:13:23:791, 0, 1049.0417, 451.9783, 55000, 23696.6825 2016-02-22 23:13:23:999, 0, 1144.4092, 460.7122, 60000, 24154.5894 2016-02-22 23:13:24:161, 0, 1239.7766, 592.3443, 65000, 31055.9006 2016-02-22 23:13:24:370, 0, 1335.1440, 458.4973, 70000, 24038.4615 2016-02-22 23:13:24:577, 0, 1430.5115, 462.9487, 75000, 24271.8447 2016-02-22 23:13:24:789, 0, 1525.8789, 451.9783, 80000, 23696.6825 2016-02-22 23:13:24:997, 0, 1621.2463, 458.4973, 85000, 24038.4615 -- Allen Michael Chan
