Hi Guozhang,
    My kafka works in product environment, a large messages are produced or 
consumed. So it is not easy to get the accurate offset through the GetOffset 
tool when an OffsetOutOfRangeException happens.But in my application, I have 
coded comparing the consuming offset with the latest offset got by 
SimpleConsumer.getOffsetsBefore API.
    I don't quite understand the kernel pagecache, so I wonder the delay 
between writting and reading.

Thanks,
Yuanjia





From: Guozhang Wang
Date: 2014-12-03 03:23
To: users@kafka.apache.org
Subject: Re: Pagecache cause OffsetOutOfRangeException
Yuanjia,

I am not sure that pagecache can be the cause of this, could you attach
your full stack trace and use the GetOffset tool Manikumar mentioned to
make sure the offset does exist in the broker?

Guozhang

On Tue, Dec 2, 2014 at 7:50 AM, Manikumar Reddy <ku...@nmsworks.co.in>
wrote:

> You can check the latest/earliest offsets of a given topic by running
> GetOffsetShell.
>
>
> https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-GetOffsetShell
>
> On Tue, Dec 2, 2014 at 2:05 PM, yuanjia8947 <yuanjia8...@163.com> wrote:
>
> > Hi all,
> > I'm using kafka 0.8.0 release now. And I often encounter the problem
> > OffsetOutOfRangeException when cosuming message by simple consumer API.
> > But I'm sure that the consuming offset is smaller than the latest offset
> > got from OffsetRequest.
> > Can it be caused by that new messages are wrote to kernel's pagecache and
> > not flush to the file yet,
> > while I'm consuming new messages from the file?
> > How fix it?
> >
> > Thanks,
> > liyuanjia
> >
> >
> >
> >
> >
> > liyuanjia
>



-- 
-- Guozhang

Reply via email to