Siddharth, Did you try using SpoutConfig spoutConfig.forceFromStart = false spoutConfig.startOffsetTime = kafka.api.OffsetRequest.LatestTime()
There are some good examples here on integrating storm and kafka https://github.com/miguno/kafka-storm-starter https://github.com/miguno/kafka-storm-starter/blob/develop/src/main/scala/com/miguno/kafkastorm/storm/KafkaStormDemo.scala -Harsha On Mon, Sep 15, 2014, at 04:37 AM, siddharth ubale wrote: > Hi all, > > I am using a kafka spout for reading data from a producer into my storm > topology. On the kafkaconfig : > 1. When i set Kafka.forcefromstart = true .. it read from the beginning , > however if i close my topology midway and run the topology again by > setting > Kafka.forcefromstart = false , it does not read from the last read > position > of the partition i.e the place from where i stopped the topology. > 2. I also tried using the newly provided values like > > kafkaConfig1.startOffsetTime = kafka.api.OffsetRequest.EarliestTime() > (-1,-2,-3 also) > > kafkaConfig1.maxOffsetBehind =100; > > but i could not get the kafka spout to read as mentioned. > > Can someone please explain how i could use the above features as the > storm > github page says the above setting are self explanatory and no > explanation > is provided. Can someone pls share their idea of reading from offsets? > > > Thanks, > Siddharth