Re: Can TermDocs.skipTo() go backwards

2008-08-28 Thread Michael McCandless
Antony Bowesman wrote: Michael McCandless wrote: Ahh right, my short term memory failed me ;) I now remember this thread. Excused :) I expect you have real work to occupy your mind! Well, understanding how people are pushing Lucene *is* the real work ;) This is exactly how Lucene grow

Re: Can TermDocs.skipTo() go backwards

2008-08-27 Thread Antony Bowesman
Michael McCandless wrote: Ahh right, my short term memory failed me ;) I now remember this thread. Excused :) I expect you have real work to occupy your mind! Yes, though LUCENE-1231 (column stride stored fields) should help this. I see from JIRA that MB has started working on this - It's

Re: Can TermDocs.skipTo() go backwards

2008-08-27 Thread Michael McCandless
Antony Bowesman wrote: Michael McCandless wrote: TermDocs.skipTo() only moves forwards. Can you use a stored field to retrieve this information, or do you really need to store it per-term-occurrence in your docs? I discussed my use case with Doron earlier and there were two options

Re: Can TermDocs.skipTo() go backwards

2008-08-27 Thread Antony Bowesman
Michael McCandless wrote: TermDocs.skipTo() only moves forwards. Can you use a stored field to retrieve this information, or do you really need to store it per-term-occurrence in your docs? I discussed my use case with Doron earlier and there were two options, either to use payloads or

Re: Can TermDocs.skipTo() go backwards

2008-08-27 Thread Michael McCandless
TermDocs.skipTo() only moves forwards. Can you use a stored field to retrieve this information, or do you really need to store it per-term-occurrence in your docs? Mike Antony Bowesman wrote: I have a custom TopDocsCollector and need to collect a payload from each final document hit

Can TermDocs.skipTo() go backwards

2008-08-27 Thread Antony Bowesman
I have a custom TopDocsCollector and need to collect a payload from each final document hit. The payload comes from a single term in each hit. When collecting the payload, I don't want to fetch the payload during the collect() method as it will make fetches which may subsequently be bumped fro

Re: TermDocs.skipTo error

2007-11-14 Thread Yonik Seeley
On Nov 14, 2007 5:29 AM, Mike Streeton <[EMAIL PROTECTED]> wrote: > I have now managed to quantify the error, it only affects Lucene 2.2 build > indexes and occurs after a period of time reusing a TermDocs object, I have > modified my test app top be a little more verbose about the conditions it

RE: TermDocs.skipTo error

2007-11-14 Thread Mike Streeton
I have now managed to quantify the error, it only affects Lucene 2.2 build indexes and occurs after a period of time reusing a TermDocs object, I have modified my test app top be a little more verbose about the conditions it fails under. Hopefully someone can track the bug down in Lucene. I have

RE: TermDocs.skipTo error

2007-11-12 Thread Mike Streeton
Thanks Mike -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: 10 November 2007 22:49 To: java-user@lucene.apache.org Subject: Re: TermDocs.skipTo error On Nov 9, 2007 11:40 AM, Mike Streeton <[EMAIL PROTECTED]> wrote: > I have just t

Re: TermDocs.skipTo error

2007-11-10 Thread Yonik Seeley
On Nov 9, 2007 11:40 AM, Mike Streeton <[EMAIL PROTECTED]> wrote: > I have just tried this again using the index I built with lucene 2.1 but > running the test using lucene 2.2 and it works okay, so it seems to be > something related to an index built using lucene 2.2. I bet you are triggering a

Re: TermDocs.skipTo error

2007-11-09 Thread Michael Busch
Mike Streeton wrote: > I have just tried this again using the index I built with lucene 2.1 but > running the test using lucene 2.2 and it works okay, so it seems to be > something related to an index built using lucene 2.2. > > Mike > Hi Mike, does this also happen with the current trunk ver

RE: TermDocs.skipTo error

2007-11-09 Thread Mike Streeton
2007 16:34 To: java-user@lucene.apache.org Subject: RE: TermDocs.skipTo error I have tried this again using Lucene 2.1 and as Erick found it works okay, I have tried it on jdk 1.6 u1 and u3 both work, but both fail when using lucene 2.2 Mike -Original Message- From: Mike Streeton

RE: TermDocs.skipTo error

2007-11-09 Thread Mike Streeton
@lucene.apache.org Subject: RE: TermDocs.skipTo error Erick, Sorry the numbers are just printed out for debugging when it is building the index. I will try it with lucene 2.1 and see what happens Thanks Mike -Original Message- From: Erick Erickson [mailto:[EMAIL PROTECTED] Sent: 09 November 2007 15

RE: TermDocs.skipTo error

2007-11-09 Thread Mike Streeton
Subject: Re: TermDocs.skipTo error FWIW, running Lucene 2.1, Java 1.5 all I get is some numbers being printed out 0 1 2 . . . 90,000 and ran through the above 4 times or so Erick On Nov 9, 2007 5:51 AM, Mike Streeton <[EMAIL PROTECTED]> wrote: > I have posted before about

Re: TermDocs.skipTo error

2007-11-09 Thread Erick Erickson
FWIW, running Lucene 2.1, Java 1.5 all I get is some numbers being printed out 0 1 2 . . . 90,000 and ran through the above 4 times or so Erick On Nov 9, 2007 5:51 AM, Mike Streeton <[EMAIL PROTECTED]> wrote: > I have posted before about a problem with TermDocs.skipTo ()

TermDocs.skipTo error

2007-11-09 Thread Mike Streeton
I have posted before about a problem with TermDocs.skipTo () but never managed to reproduce it. I have now got it to fail using the following program, please can someone try it and see if they get the stack trace: Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: Ar

Re: TermDocs.skipTo

2007-10-29 Thread Michael Busch
Mike Streeton wrote: > e.g. Iterating using TermDocs.next() and TermDocs.doc() 1,50,1,2 but > suing TermDocs.skipTo(51) returns false indicating that no doc id > 50 exists. Hi Mike, I quickly tried to reproduce this (with the same docids), but for me skipTo() works fine, i. e.

TermDocs.skipTo

2007-10-29 Thread Mike Streeton
Are there any issues surrounding TermDocs.skipTo(). I have a index that works okay if I use TermDocs.next() to find next doc id, but using skipTo to go to the one after a point can miss sometimes. e.g. Iterating using TermDocs.next() and TermDocs.doc() 1,50,1,2 but suing