GitHub user benstopford reopened a pull request: https://github.com/apache/kafka/pull/158
KAFKA-2453: Enable new consumer in EndToEndLatency You can merge this pull request into a Git repository by running: $ git pull https://github.com/benstopford/kafka KAFKA-2453b Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/158.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #158 ---- commit 71b11fac33a67ef9f0ac8ac09bcbb5305a56047f Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-08-21T16:44:48Z KAFKA-2453: migrated EndToEndLatencyTest to new consumer API. Added feature for configuring message size. Added inline assertion. commit 43d6a0678fd37d7f382d5f89c898571ae4e3cfbb Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-08-21T16:45:19Z KAFKA-2453: small change which prevents the ConsoleConsumer from throwing an exception when the Finalizer thread tries to close it. commit cac85029c7d802da29d68073545c118804bd41cb Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-08-21T17:08:29Z KAFKA-2453: Added additional arguments to call to EndToEndLatency from Performance tests commit 119a6fa545bcaf586c9cb110f0e13c1cfee1f56c Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-09-01T10:20:14Z KAFKA-2453: Rebased to trunk KAFKA-2453: removed whitespace KAFKA-2453: Formatting only commit 954f076701dd8961e3f835b08a022fc31ae74943 Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-09-01T15:30:17Z KAFKA-2453: Incorporate changes from KAFKA-2486 Previous version used an optional busy loop to get better performance by avoiding sleeps inside the API. These turned out to be a bug fixed in KAFKA-2486 so the optional busy loop has been removed. commit 4b96fab3037e6ed2ee00a0ff370168000fddcd09 Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-09-01T18:17:29Z KAFKA-2453: removed sleep which I believe is not longer needed now we have consumer.seekToEnd() commit 3e52bca1f0f711b7abdee680253f808bb871057e Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-09-01T22:04:17Z KAFKA-2453: Producer acks can be a string commit 29ce7cd9c95980f391bf3315099d285c120ace6e Author: Ben Stopford <benstopf...@gmail.com> Date: 2015-09-02T13:13:06Z KAFKA-2453: Feedback from Gwen + fix to seek problem - Fixed issue with seekToEnd evaluating lazily (i.e. when poll is called) meaning messages can be missed in slower environments (discovered when I ran this on EC2). Detailed in comments. - Removed redundant retry backoff override (this was an artifact of KAFKA-2486) - Forced producer acks to be 1 or all (i.e. synchronous) - Reduced poll to a reasonable timeout to avoid hangs in erroneous situations - Added check for results being non zero - Added check that there is only a single message returned ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---