Re: Lucene 2.9.0 leaves too many .cfs files open, causing too many files open java error.

2009-10-18 Thread Aaron McCurry
I also have seen this problem recently. I had to make a patch to our production system to at least relief the system of the deleted files handles. I did it by capturing all of the Descriptors that the FileInputIndex object creates and monitoring if the file it references still exists or n

Re: Lucene 2.9.0 leaves too many .cfs files open, causing too many files open java error.

2009-10-18 Thread Aaron McCurry
volume it only took about 10 hours for the machine to start having problems. Hence the need for the hack patch. Aaron On Oct 18, 2009, at 1:49 PM, GlenAbbeyDrive wrote: Are you using 2.9.0 or 2.4? Aaron McCurry wrote: I also have seen this problem recently. I had to make a pa

Re: Lucene as a primary datastore

2010-01-22 Thread Aaron McCurry
While I know that our situation is fairly unique, but we rebuild our indexes weekly. The source of our indexes are data marts generated from flat files. We do this because our data changes too rapidly for us to keep up with the changes. We do update the indexes at runtime, but only with about