dan norwood created KAFKA-3491:
----------------------------------
Summary: Issue with consumer close() in finally block with
'enable.auto.commit=true'
Key: KAFKA-3491
URL: https://issues.apache.org/jira/browse/KAFKA-3491
Project: Kafka
Issue Type: Bug
Components: consumer
Affects Versions: 0.9.0.1, 0.9.0.0
Reporter: dan norwood
Assignee: Neha Narkhede
Priority: Minor
imagine you have a run loop that looks like the following:
{code:java}
public void run() {
try {
consumer.subscribe(topics);
while (true) {
ConsumerRecords<K, V> records = consumer.poll(Long.MAX_VALUE);
records.forEach(record -> process(record));
}
} catch (WakeupException e) {
// ignore, we're closing
} catch (Exception e) {
log.error("Unexpected error", e);
} finally {
consumer.close();
}
}
{code}
if you run this with 'enable.auto.commit=true' and throw an exception in the
'process()' method you will still try to commit all the read, but unprocessed,
offsets in the most recent batch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
