Jeremy Custenborder created KAFKA-3260:
------------------------------------------
Summary: Increase the granularity of commit for SourceTask
Key: KAFKA-3260
URL: https://issues.apache.org/jira/browse/KAFKA-3260
Project: Kafka
Issue Type: Improvement
Components: copycat
Affects Versions: 0.9.0.1
Reporter: Jeremy Custenborder
Assignee: Ewen Cheslack-Postava
As of right now when commit is called the developer does not know which
messages have been accepted since the last poll. I'm proposing that we extend
the SourceTask class to allow records to be committed individually.
{code}
public void commitRecord(SourceRecord record) throws InterruptedException {
// This space intentionally left blank.
}
{code}
This method could be overridden to receive a SourceRecord during the callback
of producer.send. This will give us messages that have been successfully
written to Kafka. The developer then has the capability to commit messages to
the source individually or in batch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
