How to write to and read from the same index

2006-03-27 Thread Nick Atkins
I'm using Lucene running on Tomcat to index a large amount of email data and as the indexer runs through the mailbox creating, merging and deleting documents it does lots of searches at the same time to see if the document exists. Actually all my modification operations are done "in batch" every x

Re: Re-creating IndexSearcher after update

2006-03-27 Thread Nick Atkins
Luc, I tried adding your DelayCloseIndexSearcher to my project (a Tomcat app where the index is repeatedly searched and frequently updated) and as soon as an index modify occurs (by a separate thread) and I call closeWhenDone() in the main thread I get IllegalStateException("closeWhenDone() alread

Query for a non-value

2006-03-22 Thread Nick Atkins
Hi there, How do I do a query for the value of a field not being equal to something? For example, we all do Query("field:value") but I want to do Query("NOT field:value") to essentially return all the documents that do not have fields with this value? I've tried this but Lucene always returns no

Re: Lucene and Tomcat, too many open files

2006-03-17 Thread Nick Atkins
Guys, thanks for your help yesterday, I solved my problem! I was actually using an IndexSearcher in another thread that I had forgotten all about. Whoever suggested that IndexReader was to blame was right on the money. I now make sure I close my Readers and, bingo, the open files are managed ni

Unnormalized score

2006-03-17 Thread Nick Atkins
Hi, Apparently there is a way of retrieving the unnormalized score from a Hit but I have been unable to track this down. I need to return this value because an external client wants to compile results from multiple queries itself. Any help much appreciated. Cheers, Nick. -

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
200). Anyway, I the problem occurs even when I do zero searches and deletes, therefore I am only working with IndexWriters. Cheers, Nick. Yonik Seeley wrote: > On 3/16/06, Nick Atkins <[EMAIL PROTECTED]> wrote: > >> Yes, indexing only right now, although I can issue the

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
eers, Nick. Otis Gospodnetic wrote: > This happens when you are doing indexing only!? Wow, I've never seen that. > Try posting your code in a form of a unit test. > > Otis > > - Original Message > From: Nick Atkins <[EMAIL PROTECTED]> > To: java-u

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
on folks run out of file handles: they open > too many IndexReaders. The exception may be thrown when merging, but > the root cause might be something else. > > Doug > > Nick Atkins wrote: >> Hi, >> >> What's the best way to manage the number of open files used

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
rap/wsi14/poplog/man/2/ulimit > > You don't have to set it to unlimited, maybe increasing the number > will help. > > later > > Hannes > > Nick Atkins schrieb: >> Thanks Otis, I tried that but I still get the same problem at the ulimit >> -n point. I as

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
) or Lucene (1.9.1)? Many thanks, Nick Otis Gospodnetic wrote: > The easiest first step to try is to go from multi-file index structure to the > compound one. > > Otis > > - Original Message > From: Nick Atkins <[EMAIL PROTECTED]> > To: java-user@lucene.apac

Re: Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
; my indexes is already taking 2 seconds (and in a synchronized method > this is not so good). > > Tell me what you think. > > > On 3/16/06, Nick Atkins <[EMAIL PROTECTED]> wrote: > >> Hi, >> >> What's the best way to manage the number of open files

Lucene and Tomcat, too many open files

2006-03-16 Thread Nick Atkins
Hi, What's the best way to manage the number of open files used by Lucene when it's running under Tomcat? I have a indexing application running as a web app and I index a huge number of mail messages (upwards of 4 in some cases). Lucene's merging routine always craps out eventually with the