[jira] [Created] (KAFKA-3491) Issue with consumer close() in finally block with 'enable.auto.commit=true'

[dan norwood (JIRA)]

dan norwood created KAFKA-3491:
----------------------------------

             Summary: Issue with consumer close() in finally block with 
'enable.auto.commit=true'
                 Key: KAFKA-3491
                 URL: https://issues.apache.org/jira/browse/KAFKA-3491
             Project: Kafka
          Issue Type: Bug
          Components: consumer
    Affects Versions: 0.9.0.1, 0.9.0.0
            Reporter: dan norwood
            Assignee: Neha Narkhede
            Priority: Minor


imagine you have a run loop that looks like the following:
{code:java}
  public void run() {
    try {
      consumer.subscribe(topics);

      while (true) {
        ConsumerRecords<K, V> records = consumer.poll(Long.MAX_VALUE);
        records.forEach(record -> process(record));
      }
    } catch (WakeupException e) {
      // ignore, we're closing
    } catch (Exception e) {
      log.error("Unexpected error", e);
    } finally {
      consumer.close();
    }
  }
{code}

if you run this with 'enable.auto.commit=true' and throw an exception in the 
'process()' method you will still try to commit all the read, but unprocessed, 
offsets in the most recent batch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)