Re: about java.io.EOFException / java.lang.ClassNotFoundException: kafka.common.OffsetOutOfRangeException

2017-03-18 Thread Martin Gainty
From: Selina Tech Sent: Friday, March 17, 2017 9:02 PM To: users@kafka.apache.org Subject: about java.io.EOFException / java.lang.ClassNotFoundException: kafka.common.OffsetOutOfRangeException Hi: I am processing on a new Kafka topic with Spark and then I

about java.io.EOFException / java.lang.ClassNotFoundException: kafka.common.OffsetOutOfRangeException

2017-03-17 Thread Selina Tech
by 11ms 00:44:17,996 WARN - 17/03/18 00:44:17 WARN ThrowableSerializationWrapper: Task exception could not be deserialized 00:44:17,996 WARN - java.lang.ClassNotFoundException: kafka.common.OffsetOutOfRangeException 00:44:17,996 WARN - at java.net.URLClassLoader$1.run(URLClassLoader.java:366

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread ????
hello, everybody, how can I unsubscribe kafka users emails, Thank you! -- Original -- From: "Philip O'Toole";; Date: Thu, Aug 21, 2014 10:20 AM To: "users@kafka.apache.org"; Subject: Re: Keep on getting kafka.common.OffsetOutOfRang

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Philip O'Toole
s (if I have been >> following the thread correctly) -- when the retention time passes, the >> message is gone. Either consume your messages sooner, or increase your >> retention time. Kafka is not magic, it can only do what it's told. >> >> In practise I have fou

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Steve Miller
gt; On Wednesday, August 20, 2014 1:42 AM, "pradeep.si...@wipro.com" > wrote: > > > > Sure, I would try with setting longer retention hours. But I feel this would > not be good approach? Should we raise it as a bug? > > Thanks, > Pradeep Simha > Technical Le

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Guozhang Wang
, August 20, 2014 1:31 PM > To: users@kafka.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > > We had a similar issue in our dev environments, where we had to configure > aggressive log retention to save space. > And the clients ke

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Philip O'Toole
ject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times We had a similar issue in our dev environments, where we had to configure aggressive log retention to save space. And the clients kept failing with this error, on Mondays, because the message from friday had got deleted. Perh

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread pradeep.simha
:31 PM To: users@kafka.apache.org Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times We had a similar issue in our dev environments, where we had to configure aggressive log retention to save space. And the clients kept failing with this error, on Mondays, because

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Manjunath Shivakumar
://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction From: Steve Miller [st...@idrathernotsay.com] Sent: 20 August 2014 08:47 To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times That seems likely. I'

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-20 Thread Steve Miller
iginal Message- > From: Steve Miller [mailto:st...@idrathernotsay.com] > Sent: Tuesday, August 19, 2014 6:13 PM > To: users@kafka.apache.org > Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random > times > > Also, what do you have log.retention.hours set to? H

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
ssage- From: Steve Miller [mailto:st...@idrathernotsay.com] Sent: Tuesday, August 19, 2014 6:13 PM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Also, what do you have log.retention.hours set to? How often do you publish mes

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
...@gmail.com] Sent: Tuesday, August 19, 2014 10:05 PM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times How often do you push messages to the brokers? Guozhang On Tue, Aug 19, 2014 at 2:12 AM, wrote: > Hi Team, > > Can someo

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread Guozhang Wang
.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: > Random times > > Hi Neha, > > Yes, I am using the latest version ie (0.8.1.1). > > Hi Guozhang, > > These are the values: > > #log.retention.bytes= 1073741824 (Yes, this was commented by default) > > log.r

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread Steve Miller
.si...@wipro.com [mailto:pradeep.si...@wipro.com] > Sent: Tuesday, August 19, 2014 9:30 AM > To: users@kafka.apache.org > Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random > times > > Hi Neha, > > Yes, I am using the latest version ie (0.8.1.1)

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-19 Thread pradeep.simha
...@wipro.com [mailto:pradeep.si...@wipro.com] Sent: Tuesday, August 19, 2014 9:30 AM To: users@kafka.apache.org Subject: RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Hi Neha, Yes, I am using the latest version ie (0.8.1.1). Hi Guozhang, These are the values

RE: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread pradeep.simha
hanks, Pradeep Simha Technical Lead -Original Message- From: Neha Narkhede [mailto:neha.narkh...@gmail.com] Sent: Tuesday, August 19, 2014 2:27 AM To: users@kafka.apache.org Subject: Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times Also, what version of Kafka are you

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread Neha Narkhede
gt; > getting these strange errors while consuming the topic: > > > > > > kafka.common.OffsetOutOfRangeException: Request for offset 19 but we only > > have log segments in the range 0 to 0. > > Sometimes I get like this: > > > > > > kafka.common.OffsetO

Re: Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread Guozhang Wang
; > Of late I am facing strange issue w.r.t Kafka. Random times I keep on > getting these strange errors while consuming the topic: > > > kafka.common.OffsetOutOfRangeException: Request for offset 19 but we only > have log segments in the range 0 to 0. >

Keep on getting kafka.common.OffsetOutOfRangeException: Random times

2014-08-18 Thread pradeep.simha
Hi Team, Of late I am facing strange issue w.r.t Kafka. Random times I keep on getting these strange errors while consuming the topic: kafka.common.OffsetOutOfRangeException: Request for offset 19 but we only have log segments in the range 0 to 0. Sometimes I get like this

Re: kafka.common.OffsetOutOfRangeException

2013-11-19 Thread Oleg Ruchovets
ts >>> wrote: > >> > >>> We are working with kafka (0.7.2) + storm. > >>> 1) We deployed 1st topology which subscribed on Kafka topic and it is > >>> working fine already couple of weeks. > >>>2) Yesterd

Re: kafka.common.OffsetOutOfRangeException

2013-11-19 Thread Philip O'Toole
> wrote: >> >>> We are working with kafka (0.7.2) + storm. >>> 1) We deployed 1st topology which subscribed on Kafka topic and it is >>> working fine already couple of weeks. >>>2) Yesterday we deploy 2nd topology which subscribed on the s

Re: kafka.common.OffsetOutOfRangeException

2013-11-18 Thread Oleg Ruchovets
topology which subscribed on the same > Kafka > > topic , but 2nd topology immediately failed with exception: > > > > *What can cause such behavior and how we can resolve the issue: * > > > > > > java.lang.RuntimeException: kafka.common.OffsetOutOfRang

Re: kafka.common.OffsetOutOfRangeException

2013-11-18 Thread Philip O'Toole
ediately failed with exception: > > *What can cause such behavior and how we can resolve the issue: * > > > java.lang.RuntimeException: kafka.common.OffsetOutOfRangeException > > at > > backtype.storm.utils.DisruptorQueue.consumeBatchToCursor

kafka.common.OffsetOutOfRangeException

2013-11-18 Thread Oleg Ruchovets
can cause such behavior and how we can resolve the issue: * java.lang.RuntimeException: kafka.common.OffsetOutOfRangeException at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:87) at

Re: kafka.common.OffsetOutOfRangeException

2013-03-15 Thread Neha Narkhede
> > Thanks gurus. :) > > Chris > > - Original Message - > From: "Christopher Alexander" > To: users@kafka.apache.org > Sent: Thursday, March 14, 2013 11:22:27 AM > Subject: Re: kafka.common.OffsetOutOfRangeException > > OK, I re-reviewed the Kafka design doc

Re: kafka.common.OffsetOutOfRangeException

2013-03-15 Thread Christopher Alexander
ild a trouble-shooting solution set for an eventual production release. Thanks gurus. :) Chris - Original Message - From: "Christopher Alexander" To: users@kafka.apache.org Sent: Thursday, March 14, 2013 11:22:27 AM Subject: Re: kafka.common.OffsetOutOfRangeException OK, I

Re: kafka.common.OffsetOutOfRangeException

2013-03-14 Thread Christopher Alexander
ffect another app that is also using ZK. 2. In Kafka by wiping the mytopic-0 file? Thanks, Chris - Original Message - From: "Christopher Alexander" To: users@kafka.apache.org Sent: Thursday, March 14, 2013 11:02:57 AM Subject: Re: kafka.common.OffsetOutOfRangeException Thanks Jun

Re: kafka.common.OffsetOutOfRangeException

2013-03-14 Thread Christopher Alexander
AM Subject: Re: kafka.common.OffsetOutOfRangeException Chris, The last offset can be calculated by adding the file size to the name of the last Kafka segment file. Then you can see if your offset is in the range. Thanks, Jun On Wed, Mar 13, 2013 at 2:53 PM, Christopher Alexander < calexan...@gravycard.com> wrote: &

Re: kafka.common.OffsetOutOfRangeException

2013-03-13 Thread Jun Rao
e > > This reveals binary data. No offset visible. > > Are these the locations for finding the current/recent offsets? Thanks. > > > - Original Message - > From: "Philip O'Toole" > To: users@kafka.apache.org > Sent: Wednesday, March 13, 2013 5:04:01

Re: kafka.common.OffsetOutOfRangeException

2013-03-13 Thread Philip O'Toole
isible. > > Are these the locations for finding the current/recent offsets? Thanks. > > > - Original Message - > From: "Philip O'Toole" > To: users@kafka.apache.org > Sent: Wednesday, March 13, 2013 5:04:01 PM > Subject: Re: kafka.common.OffsetOutOfRangeExc

Re: kafka.common.OffsetOutOfRangeException

2013-03-13 Thread Christopher Alexander
ocations for finding the current/recent offsets? Thanks. - Original Message - From: "Philip O'Toole" To: users@kafka.apache.org Sent: Wednesday, March 13, 2013 5:04:01 PM Subject: Re: kafka.common.OffsetOutOfRangeException Is offset 562949953452239, partition 0, actually av

Re: kafka.common.OffsetOutOfRangeException

2013-03-13 Thread Philip O'Toole
ing repeated exceptions of the following: > > [2013-03-13 16:45:14,615] ERROR error when processing request > FetchRequest(topic:promoterregack, part:0 offset:562949953452239 > maxSize:1048576) (kafka.server.KafkaRequestHandlers) > kafka.common.OffsetOutOfRangeException: offset 5629

kafka.common.OffsetOutOfRangeException

2013-03-13 Thread Christopher Alexander
) (kafka.server.KafkaRequestHandlers) kafka.common.OffsetOutOfRangeException: offset 562949953452239 is out of range at kafka.log.Log$.findRange(Log.scala:46) at kafka.log.Log.read(Log.scala:264) at kafka.server.KafkaRequestHandlers.kafka$server$KafkaRequestHandlers