Use the Simple Consumer API if you want to control which offset in a partition the client should read messages from.
Use the High level consumer, if you don'nt care about offsets. Offsets are per partition and stored on zookeeper. regards On Tue, Apr 28, 2015 at 4:38 AM, Gomathivinayagam Muthuvinayagam < sankarm...@gmail.com> wrote: > I have just posted the following question in stackoverflow. Could you > answer the following questions? > > I would like to use Kafka high level consumer API, and at the same time I > would like to disable auto commit of offsets. I tried to achieve this > through the following steps. > > 1) auto.commit.enable = false2) offsets.storage = kafka3) > dual.commit.enabled = false > > I created a offset manager, which periodically creates offsetcommit request > to kafka and commits the offset. > > Still I have the following questions > > 1) Does high level consumer API automatically fetches offset from kafka > storage and initializes itself with that offset? Or should I use simple > consumer API to achieve this? > > 2) Does kafka based storage for offsets is repicated across all brokers? Or > it is maintained on only one broker? > > > http://stackoverflow.com/questions/29909179/kafka-offsetcommit-request-with-high-level-consumer-api > Thanks & Regards, > -- http://khangaonkar.blogspot.com/
