Currently, the only way to rewind the high level consumer to a different offset is to first shutdown all instances of the consumer, update zookeeper with the desired offsets and then restart the consumer. We are addressing this in the new consumer APIs for Kafka 0.9. If you can review the proposal <http://mail-archives.apache.org/mod_mbox/kafka-users/201402.mbox/%3CCAOG_4QYBHwyi0xN=hl1fpnrtkvfjzx14ujfntft3nn_mw3+...@mail.gmail.com%3E>on this thread, that will be appreciated.
Thanks, Neha On Thu, Feb 27, 2014 at 8:25 AM, Yonghui Zhao <zhaoyong...@gmail.com> wrote: > Hi, > > In kafka 0.8, does high level consumer support setting offset? > > Our service reads kafka data but won't flush the data immediately, so if > restarted the data in memory will be lost. We want to reset kafka consumer > offset to an old offset. > > If the consumer group has only 1 machine, we can record all partition > offset for our topic in disk. Does the high level consumer support > setting offset in zk to the recorded offset? >