Re: Kafka Offset Management

2017-07-15 Thread Matthias J. Sax
>> if my application crash and i use pretty old offset(which are still within >> retention window), would kafka start from there ? Yes. If you seek() to an old offset it will start from there. >> or does kafka still commit on every next poll, granted auto commit is off. if auto commit is off,

Kafka Offset Management

2017-07-14 Thread Syed Rizwan Hashmi
Hi , I have wrote kafka consumer where i am managing kafka offset within our storage. The reason why we are doing this, In case of failure we should be able to restart from same time. I have disabled auto commit flag for offset. The writing of db happened that include offset write on interval