Re: IndexReader.isCurrent very slow in 2.1

2007-05-12 Thread Andreas Guther
t; Sent: Friday, May 11, 2007 11:03 AM > To: java-user@lucene.apache.org > Subject: Re: IndexReader.isCurrent very slow in 2.1 > > > : Are there are large number of files in your index directory? > > and is there any correlation between the number files matching segment* >

Re: IndexReader.isCurrent very slow in 2.1

2007-05-12 Thread Erick Erickson
igible, i.e. less than 10 millis per call. Thanks for your input. Andreas -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Friday, May 11, 2007 11:03 AM To: java-user@lucene.apache.org Subject: Re: IndexReader.isCurrent very slow in 2.1 : Are there are large num

RE: IndexReader.isCurrent very slow in 2.1

2007-05-12 Thread Michael McCandless
"Andreas Guther" <[EMAIL PROTECTED]> wrote: > I have optimized our index directories using the compound index format. > I have also moved the index directories for testing purposes local to > the search process (before it was over network and shared NTFS file > system). > > Now the time for gett

RE: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Andreas Guther
. less than 10 millis per call. Thanks for your input. Andreas -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Friday, May 11, 2007 11:03 AM To: java-user@lucene.apache.org Subject: Re: IndexReader.isCurrent very slow in 2.1 : Are there are large number of

Re: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Chris Hostetter
: I am experiencing a same problem with some 40 segments. Chris, Do you have do you have 40 segments, or do you have 40 files matching the glob segement* .. there is a differnece (the "segment" files records the number of segments, as of 2.1 they are versioned so they have names like "segments_7"

RE: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Andreas Guther
then will come back with more information. Andreas -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Friday, May 11, 2007 11:03 AM To: java-user@lucene.apache.org Subject: Re: IndexReader.isCurrent very slow in 2.1 : Are there are large number of files in your

Re: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread jafarim
I am experiencing a same problem with some 40 segments. Chris, Do you have any recommendation on the file system to use? On 5/11/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : Are there are large number of files in your index directory? and is there any correlation between the number files

Re: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Chris Hostetter
: Are there are large number of files in your index directory? and is there any correlation between the number files matching segment* and the time isCurrent taks? it would also be handy to know what filesystem you use as well ... directory listings may be more expensive on some filesystems then

Re: IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Michael McCandless
"Andreas Guther" <[EMAIL PROTECTED]> wrote: > I moved today from Lucene 2.0 to 2.1 and I noticed that the > IndexReader.isCurrent() call is very expensive. What took 20 > milliseconds in 2.0 now takes seconds in 2.1. > > I have the following scenario: > > - 7 index directories of different size

IndexReader.isCurrent very slow in 2.1

2007-05-11 Thread Andreas Guther
I moved today from Lucene 2.0 to 2.1 and I noticed that the IndexReader.isCurrent() call is very expensive. What took 20 milliseconds in 2.0 now takes seconds in 2.1. I have the following scenario: - 7 index directories of different size, ranging from some MB to 5 GIG - Some index are upgraded