Hi Predeep, I think I misinterpreted your question. Are you trying to consume a topic multiple times for each consumer instance or consume one topic with multiple consumer instances?
In case that you want to consume a topic multiple times with one consumer instance, `seekToBeginning`` will reset the offset to the beginning in the next ``poll``. In case that you want each thread to consume the same topic multiple times, you need to use multiple consumer groups. Otherwise, only one consumer instance will be will be consuming the topic. Thanks, Liquan On Sun, Apr 10, 2016 at 12:21 AM, Harsha <ka...@harsha.io> wrote: > Pradeep, > How about > > https://kafka.apache.org/090/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html#seekToBeginning%28org.apache.kafka.common.TopicPartition...%29 > > -Harsha > > On Sat, Apr 9, 2016, at 09:48 PM, Pradeep Bhattiprolu wrote: > > Liquan , thanks for the response. > > By setting the auto commit to false do i have to manage queue offset > > manually ? > > I am running a multiple threads with each thread being a consumer, it > > would > > be complicated to manage offsets across threads, if i dont use kafka's > > automatic consumer group abstraction. > > > > Thanks > > Pradeep > > > > On Sat, Apr 9, 2016 at 3:12 AM, Liquan Pei <liquan...@gmail.com> wrote: > > > > > Hi Pradeep, > > > > > > Can you try to set enable.auto.commit = false if you want to read to > the > > > earliest offset? According to the documentation, auto.offset.reset > controls > > > what to do when there is no initial offset in Kafka or if the current > > > offset does not exist any more on the server (e.g. because that data > has > > > been deleted). In case that auto commit is enabled, the committed > offset is > > > available in some servers. > > > > > > Thanks, > > > Liquan > > > > > > On Fri, Apr 8, 2016 at 10:44 PM, Pradeep Bhattiprolu < > pbhatt...@gmail.com> > > > wrote: > > > > > > > Hi All > > > > > > > > I am a newbie to kafka. I am using the new Consumer API in a thread > > > acting > > > > as a consumer for a topic in Kafka. > > > > For my testing and other purposes I have read the queue multiple > times > > > > using console-consumer.sh script of kafka. > > > > > > > > To start reading the message from the beginning in my java code , I > have > > > > set the value of the auto.offset.reset to "earliest". > > > > > > > > However that property does not guarantee that i begin reading the > > > messages > > > > from start, it goes by the most recent smallest offset for the > consumer > > > > group. > > > > > > > > Here is my question, > > > > Is there a assured way of starting to read the messages from > beginning > > > from > > > > Java based Kafka Consumer ? > > > > Once I reset one of my consumers to zero, do i have to do offset > > > management > > > > myself for other consumer threads or does kafka automatically lower > the > > > > offset to the first threads read offset ? > > > > > > > > Any information / material pointing to the solution are highly > > > appreciated. > > > > > > > > Thanks > > > > Pradeep > > > > > > > > > > > > > > > > -- > > > Liquan Pei > > > Software Engineer, Confluent Inc > > > > -- Liquan Pei Software Engineer, Confluent Inc
