[ https://issues.apache.org/jira/browse/KAFKA-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jay Kreps updated KAFKA-1000: ----------------------------- Description: Kafka currently stores offsets in zookeeper. This is a problem for several reasons. First it means the consumer must embed the zookeeper client which is not available in all languages. Secondly offset commits are actually quite frequent and Zookeeper does not scale this kind of high-write load. This Jira is for tracking the phase #2 of Offset Management [0]. Joel and I have been working on this. [1] is the overall design of the feature. [0] : https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management [1] : https://cwiki.apache.org/confluence/display/KAFKA/Inbuilt+Consumer+Offset+Management was: This Jira is for tracking the phase #2 of Offset Management [0]. Joel and I have been working on this. [1] is the overall design of the feature. [0] : https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management [1] : https://cwiki.apache.org/confluence/display/KAFKA/Inbuilt+Consumer+Offset+Management > Inbuilt consumer offset management feature for kakfa > ---------------------------------------------------- > > Key: KAFKA-1000 > URL: https://issues.apache.org/jira/browse/KAFKA-1000 > Project: Kafka > Issue Type: New Feature > Components: consumer > Affects Versions: 0.8.1 > Reporter: Tejas Patil > Assignee: Tejas Patil > Priority: Minor > Labels: features > > Kafka currently stores offsets in zookeeper. This is a problem for several > reasons. First it means the consumer must embed the zookeeper client which is > not available in all languages. Secondly offset commits are actually quite > frequent and Zookeeper does not scale this kind of high-write load. > This Jira is for tracking the phase #2 of Offset Management [0]. Joel and I > have been working on this. [1] is the overall design of the feature. > [0] : https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management > [1] : > https://cwiki.apache.org/confluence/display/KAFKA/Inbuilt+Consumer+Offset+Management -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira