Re: Setting the consumer's offset

2015-11-18 Thread Yonghui Zhao
Hi, How about this feature? thanks *We do plan to allow the high level consumer to specify a starting offset inthe future when we revisit the consumer design. Some of the details aredescribed inhttps://cwiki.apache.org/confluence/display/KAFKA/Consumer+Client+Re-Design

Re: Setting the consumer's offset

2013-04-02 Thread Jun Rao
Currently, we have tools like ImportOffset that can update the starting offset of a consumer in ZK. However, one has to stop all consumers first. We do plan to allow the high level consumer to specify a starting offset in the future when we revisit the consumer design. Some of the details are desc

Re: Setting the consumer's offset

2013-04-02 Thread James Englert
I wrote some code herethat resets the offset. You just need to be sure to set this as the consumer(s) is starting up. I'm not certain if it is the "right way

Re: Setting the consumer's offset

2013-04-01 Thread Jun Rao
Sean, A broker can have multiple topics, each with multiple partitions. Each partition can be consumed by multiple consumers. Our high level consumer API doesn't allow you to specify a starting offset. SimpleConsumer does. If you use SimpleConsumer, you are responsible for managing the consumptio

Setting the consumer's offset

2013-04-01 Thread Sean Grayson
Hello, Hopefully I'm sending this question to the right place. I'm currently trying to set up a consumer that will allow me to specify the offset, partition, and consumer group ID all at the same time. This obviously causes a dilemma since neither the low-level or high-level consumer APIs seem to