Re: offset consume in JAVA api

2015-11-23 Thread Yonghui Zhao
Thanks Guozhang. In our scenario, each one group only has 1 consumer, so it is safe to do this. 2015-11-21 8:21 GMT+08:00 Guozhang Wang : > Yonghui, > > You can use ZookeeperConsumerConnector.commitOffsets() to commit arbitrary > offsets, but be careful using it to seek forward / backward: you

Re: offset consume in JAVA api

2015-11-20 Thread Guozhang Wang
Yonghui, You can use ZookeeperConsumerConnector.commitOffsets() to commit arbitrary offsets, but be careful using it to seek forward / backward: you need to make sure everyone reads the committed offsets right after it is written (e.g. force a rebalance), and no one else override it beforehand. K

offset consume in JAVA api

2015-11-19 Thread Yonghui Zhao
Hi, I found in 0.9, def commitOffsets(offsetsToCommit: java.util.Map[TopicAndPartition, OffsetAndMetadata], retryOnFailure: Boolean) is added to ZookeeperConsumerConnector. If I want to read data backwards or forwards, can I use this API to commit new offset and then read data from new offset?