In order to support rollbacks and checkpoints, there would have to be a way to both supply partition offsets to the consumer before reading, as well as retrieve partition offsets from them consumer once reading is complete.
>From what I've read here, it appears that neither the ConsumerConnector nor the ZookeeperConsumerConnector have either of those capabilities. In order to finely manage offsets, only the SimpleConsumer will work. Is that the correct interpretation? --Tom On Thu, Dec 20, 2012 at 11:13 AM, Neha Narkhede <neha.narkh...@gmail.com> wrote: >> An alternative to using simpleconsumer in this use case is to use the >> zookeeper consumer connector and turn off auto commit. >> > > Keep in mind that this works only if you don't care about controlling per > partition rewind capability. > The high level consumer will not give you control over which partitions > your consumer consumes and > which partitions it commits the offsets for. If you need to rewind > consumption for a subset of those partitions, > then ZookeeperConsumerConnector will not work for you. > > Thanks, > Neha
