Hello all,

I'd like to propose a change that would allow the producer performance test to 
have a warmup phase where the statistics gathered could be separated from 
statistics gathered during steady state.

Although startup is an important phase of Kafka operations and special 
attention should be paid to optimizing startup performance, often we would like 
to understand Kafka performance during steady-state operation, separate from 
its performance during producer startup.  It's common for new producers, like 
in a fresh producer performance test run, to have high latency during startup. 
This high latency can complicate the understanding of steady-state performance, 
even when collecting long-running tests.  If we want to understand steady-state 
latency separate from startup latency, we can collect measurements for each 
phase in disjoint sets then present statistics on each set independently or as 
a combined population of measurements.  This feature would be completely 
optional and could be represented by a new command line flag for the producer 
performance test, '--warmup-records'.

KIP: KIP-1052: Enable warmup in producer performance test - Apache Kafka - 
Apache Software 
Foundation<https://cwiki.apache.org/confluence/display/KAFKA/KIP-1052%3A+Enable+warmup+in+producer+performance+test>

Thank you,
Matt Welch

Reply via email to