RE: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-04 Thread Stephen GRAY
dless [mailto:luc...@mikemccandless.com] Sent: Monday, 4 November 2013 9:49 PM To: Lucene Users Subject: Re: splitting docIds from a search by segment [SEC=UNOFFICIAL] On Sun, Nov 3, 2013 at 7:59 PM, Stephen GRAY wrote: > UNOFFICIAL > > Hi Mike, > > I ran it again and this time the

Re: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-04 Thread Michael McCandless
On Sun, Nov 3, 2013 at 7:59 PM, Stephen GRAY wrote: > UNOFFICIAL > > Hi Mike, > > I ran it again and this time the two methods came out about the same: 168 - > 288 ms to process 173,000 documents for the walking method and 160 - 205 ms > for the MultiDocValues method . I don't know what was happ

RE: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-03 Thread Stephen GRAY
reDoc.doc. > > Regards, > Steve > > -Original Message- > From: Kyle Judson [mailto:kvjud...@hotmail.com] > Sent: Sunday, 3 November 2013 12:37 AM > To: java-user@lucene.apache.org > Subject: Re: splitting docIds from a search by segment > [SEC=UNOFFICIAL] &g

Re: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-03 Thread Michael McCandless
phen Gray > Java Developer > Border Midrange Systems Support > Department of Immigration and Border Protection > Phone: (02) 6223 9207 > Mobile: 0419 885 959 > > > -Original Message- > From: Kyle Judson [mailto:kvjud...@hotmail.com] > Sent: Sunday, 3 November 2013 1

RE: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-03 Thread Stephen GRAY
n and Border Protection Phone: (02) 6223 9207 Mobile: 0419 885 959 -Original Message- From: Kyle Judson [mailto:kvjud...@hotmail.com] Sent: Sunday, 3 November 2013 12:37 AM To: java-user@lucene.apache.org Subject: Re: splitting docIds from a search by segment [SEC=UNOFFICIAL] All, Is the

RE: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-03 Thread Stephen GRAY
>performance imrpovement I get from the mre complicated method is worth >the extra complexity. > >Thanks, >Steve > >-Original Message- >From: Michael McCandless [mailto:luc...@mikemccandless.com] >Sent: Wednesday, 30 October 2013 9:57 PM >To: Lucene Users >

Re: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-02 Thread Kyle Judson
I get from the mre complicated method is worth >the extra complexity. > >Thanks, >Steve > >-Original Message- >From: Michael McCandless [mailto:luc...@mikemccandless.com] >Sent: Wednesday, 30 October 2013 9:57 PM >To: Lucene Users >Subject: Re: splittin

Re: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-11-02 Thread Kyle Judson
All, Is the best way to get the docIDs in a case like this to use IndexSercher.search to get TopDocs and then get the ScoreDoc[] from TopDocs.scoreDocs? Thanks Kyle On 10/30/13 4:56 AM, "Michael McCandless" wrote: >You should try MultiDocValues first; it's trivial to use and may not >be horr

RE: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-10-30 Thread Stephen GRAY
Sent: Wednesday, 30 October 2013 9:57 PM To: Lucene Users Subject: Re: splitting docIds from a search by segment [SEC=UNOFFICIAL] You should try MultiDocValues first; it's trivial to use and may not be horribly slow. It must do a binary-search for every docID lookup. And then if this is too slow

Re: splitting docIds from a search by segment [SEC=UNOFFICIAL]

2013-10-30 Thread Michael McCandless
You should try MultiDocValues first; it's trivial to use and may not be horribly slow. It must do a binary-search for every docID lookup. And then if this is too slow, assuming you traverse the docIDs in order, you can use IndexReader.leaves() to get the sub-readers. The docIDs are just "appende