In our project we use senseidb to consume kafka data. Senseidb will process the message immediately but won't flush to disk immeidately. So if senseidb crash then all result not flushed will be lost， we want to rewind kafka. The offset we want to rewind to is the flush checkpoint. In this case, we will lost some data
Sent from my iPad 在 2012-12-22，1:37，Neha Narkhede <neha.narkh...@gmail.com> 写道： > > But if crash happens just after offset committed, then unprocessed message > in consumer will be skipped after reconnected. > > If the consumer crashes, you will get duplicates, not lose any data. > > Thanks, > Neha >
