Slowing down (rate-limiting/throttling) IndexWriter.optimize

2008-08-20 Thread Halsey, Stephen
Hi, We are using lucene to index a large number of documents (millions) and we currently optimize half the index in the background every 2 days, to stop it becoming too fragmented. This takes about an hour and we are finding during this time searches are slowed down dramatically on that machine.

RE: Leaking org.apache.lucene.index.* objects

2007-02-23 Thread Halsey, Stephen
Great, thanks a lot for that Hoss. Glad to hear it has been fixed. Steve. >-Original Message- >From: Chris Hostetter [mailto:[EMAIL PROTECTED] >Sent: 10 February 2007 06:14 >To: java-user@lucene.apache.org >Cc: Otis Gospodnetic >Subject: RE: Leaking org.apache.lucene.index.* objects >

RE: Leaking org.apache.lucene.index.* objects

2007-02-09 Thread Halsey, Stephen
Hi Otis, Its funny, but I'm having a memory leak with Hibernate that I spent the whole of yesterday banging my head against a wall about and so when searching for emails with Leak in the title came across your message. I'm probably going to hit the same problem as you for long running multi-thread

RE: Changing the scoring (newest doc date first)

2006-05-30 Thread Halsey, Stephen
Hi, I'm interested in getting a date ordered search on a very large index too, as we are having some scaling issues with the Sort object and its regeneration, and so was interested in your question and the answers above. Aviran mentioned using a boost in the query to get a rough sort on dates