I think your request log is empty because you might not have a directory at /logs. I think it should be logs/kafka/kafka-request.log
Thanks, Neha On Thu, Aug 22, 2013 at 1:02 PM, Wu, Jiang2 <jiang2...@citi.com> wrote: > The kafka-request.log is empty. > > This is the related log4j.properties part: > > log4j.appender.requestAppender=org.apache.log4j.RollingFileAppender > #log4j.appender.requestAppender.DatePattern='.'yyyy-MM-dd-HH > log4j.appender.requestAppender.MaxFileSize=10MB > log4j.appender.requestAppender.MaxBackupIndex=20 > log4j.appender.requestAppender.File=/logs/kafka/kafka-request.log > log4j.appender.requestAppender.layout=org.apache.log4j.PatternLayout > log4j.appender.requestAppender.layout.ConversionPattern=[%d] %p %m (%c)%n > > Other logs including server.log, controller.log, state-change.log are all > correct. > > Regards, > Jiang > > -----Original Message----- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Thursday, August 22, 2013 3:33 PM > To: users@kafka.apache.org > Subject: Re: repeated for request offset out of range > > Could you check the kafka-request.log for these FetchRequests and see if > they are sent by the same clientId ? Also, from the same kafka-request.log, > could you check if the Kafka server received an OffsetRequest after these > FetchRequests ? > > Thanks, > Neha > > > On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <jiang2...@citi.com> wrote: > > > Hi, > > > > In our log we see there are repeated errors due to the same request > > whose offset is out of range. As I understand when out of range > > happens, the consumer should reset its offset, therefore such error > > should happen only once. Does the log indicate a bug? > > > > Thanks, > > Jiang > > > > > > [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing > > fetch request for partition [xxxxxx,0] offset 2717035 from consumer > > with correlation id 324387 (kafka.server.KafkaApis) > > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but > > we only have log segments in the range 2720184 to 2724642. > > at kafka.log.Log.read(Log.scala:417) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > at > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310) > > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276) > > at kafka.server.KafkaApis.handle(KafkaApis.scala:65) > > at > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > at java.lang.Thread.run(Thread.java:722) > > [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing > > fetch request for partition [xxxxxx,0] offset 2717035 from consumer > > with correlation id 324387 (kafka.server.KafkaApis) > > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but > > we only have log segments in the range 2720184 to 2724642. > > at kafka.log.Log.read(Log.scala:417) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > at > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310) > > at > > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556) > > at > > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538) > > at > > > kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216) > > at java.lang.Thread.run(Thread.java:722) > > [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing > > fetch request for partition [xxxxxx,0] offset 2717035 from consumer > > with correlation id 324388 (kafka.server.KafkaApis) > > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but > > we only have log segments in the range 2720184 to 2724642. > > at kafka.log.Log.read(Log.scala:417) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314) > > at > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > at > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > at > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310) > > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276) > > at kafka.server.KafkaApis.handle(KafkaApis.scala:65) > > at > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > at java.lang.Thread.run(Thread.java:722) > > >
