Hi, I push maybe once in 15 mins or more like that. Does pushing messages frequently or less frequently have affect on this exception? If so, how do I get rid of this? Can you please guide me?
Thanks, Pradeep Simha Technical Lead -----Original Message----- From: Guozhang Wang [mailto:wangg...@gmail.com] Sent: Tuesday, August 19, 2014 10:05 PM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times How often do you push messages to the brokers? Guozhang On Tue, Aug 19, 2014 at 2:12 AM, <pradeep.si...@wipro.com> wrote: > Hi Team, > > Can someone please help me in this? This is really becoming road block > to our project we should decide whether to continue to use Kafka or > some other project as it is becoming too much of unstable. > > Thanks, > Pradeep Simha > Technical Lead > > -----Original Message----- > From: pradeep.si...@wipro.com [mailto:pradeep.si...@wipro.com] > Sent: Tuesday, August 19, 2014 9:30 AM > To: users@kafka.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > > Hi Neha, > > Yes, I am using the latest version ie (0.8.1.1). > > Hi Guozhang, > > These are the values: > > #log.retention.bytes= 1073741824 (Yes, this was commented by default) > > log.retention.check.interval.ms=60000 > > Am I doing anything wrong here? Since I haven't touched this > properties file. > > Thanks, > Pradeep Simha > Technical Lead > > -----Original Message----- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Tuesday, August 19, 2014 2:27 AM > To: users@kafka.apache.org > Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > > Also, what version of Kafka are you using? 0.8.1.1 is the latest most > stable version. > > > On Mon, Aug 18, 2014 at 9:36 AM, Guozhang Wang <wangg...@gmail.com> wrote: > > > Hi Pradeep, > > > > It seems your logs gets deleted due to retention policy. Could you > > check the config values for log.retention.bytes and > > log.retention.check.interval.ms? > > > > http://kafka.apache.org/documentation.html#brokerconfigs > > > > Guozhang > > > > > > On Mon, Aug 18, 2014 at 5:49 AM, <pradeep.si...@wipro.com> wrote: > > > > > Hi Team, > > > > > > Of late I am facing strange issue w.r.t Kafka. Random times I keep > > > on getting these strange errors while consuming the topic: > > > > > > > > > kafka.common.OffsetOutOfRangeException: Request for offset 19 but > > > we only have log segments in the range 0 to 0. > > > Sometimes I get like this: > > > > > > > > > kafka.common.OffsetOutOfRangeException: Request for offset 19 but > > > we only have log segments in the range 19 to 22. > > > > > > That number keeps on changing (with random ranges). I don't know > > > what is the problem here. Both producer and consumer will work > > > perfectly, but I keep on getting these errors randomly. In that > > > situation if I clear the logs, remove the broker again it starts > working fine again. > > > > > > Can anyone please help me in this regard? This is affecting our > > > application stability, if any more information required I can > > > provide, > > also > > > we are using only the defaults provided by the kafka we didn't > > > changed > > any > > > settings. > > > > > > Thanks, > > > Pradeep Simha > > > Technical Lead > > > > > > The information contained in this electronic message and any > > > attachments to this message are intended for the exclusive use of > > > the addressee(s) > > and > > > may contain proprietary, confidential or privileged information. > > > If you > > are > > > not the intended recipient, you should not disseminate, distribute > > > or > > copy > > > this e-mail. Please notify the sender immediately and destroy all > > > copies > > of > > > this message and any attachments. > > > > > > WARNING: Computer viruses can be transmitted via email. The > > > recipient should check this email and any attachments for the > > > presence > of viruses. > > > The company accepts no liability for any damage caused by any > > > virus transmitted by this email. > > > > > > www.wipro.com > > > > > > > > > > > -- > > -- Guozhang > > > > The information contained in this electronic message and any > attachments to this message are intended for the exclusive use of the > addressee(s) and may contain proprietary, confidential or privileged > information. If you are not the intended recipient, you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately and destroy all copies of this message and any attachments. > > WARNING: Computer viruses can be transmitted via email. The recipient > should check this email and any attachments for the presence of viruses. > The company accepts no liability for any damage caused by any virus > transmitted by this email. > > www.wipro.com > > The information contained in this electronic message and any > attachments to this message are intended for the exclusive use of the > addressee(s) and may contain proprietary, confidential or privileged > information. If you are not the intended recipient, you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately and destroy all copies of this message and any attachments. > > WARNING: Computer viruses can be transmitted via email. The recipient > should check this email and any attachments for the presence of viruses. > The company accepts no liability for any damage caused by any virus > transmitted by this email. > > www.wipro.com > -- -- Guozhang The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
