Re: addIndexes getting slower and slower plus eating up Mem

2006-07-07 Thread Dominik Bruhn
Hy, On Friday 07 July 2006 12:23 mark harwood wrote: > Out of interest, why are you using a RAMDirectory here? An IndexWriter uses > one internally of size IndexWriter.setMaxBufferedDocs so you get the > benefits of buffering automatically when writing to a File-based directory. realy? I read the

Re: addIndexes getting slower and slower plus eating up Mem

2006-07-07 Thread mark harwood
The answer is because addIndexes() currently always does an optimize post-merge. If I recall correctly optimize() will create a complete copy of the existing index during the optimize process then delete the old one so this shouldn't be done too often. Out of interest, why are you using a RAMDi

addIndexes getting slower and slower plus eating up Mem

2006-07-07 Thread Dominik Bruhn
Hy, I use the following code to index about 1 Million Documents to a empty index: = private static void do_searchindex(Connection target) throws SQLException,IOException { int i=1164; PostIndexer.createIndexDir(); //Creates Index-Director