Re: Indexing very slow.

2006-07-03 Thread peter velthuis
ditions and > close it only after adding last document. > > Optimize() merges all index segments to single segment and as index > grows it takes longer and longer. Optimizing has no impact on indexing > so it should be performed once at the end of indexing to optimize index > for s

Re: Indexing very slow.

2006-07-03 Thread peter velthuis
database connection. Also, you might reconsider tokenizing all fields... is it neccessary? You have to store all of them? (i dont know the usage of your index, so its a bit hard to know for sure) - Aleksander On Mon, 03 Jul 2006 10:52:15 +0200, peter velthuis <[EMAIL PROTECTED]> wrote: >

Indexing very slow.

2006-07-03 Thread peter velthuis
When i start the program its fast.. about 10 docs per second. but after about 15000 it slows down very much. Now it does 1 doc per second and it is at nr# 40 000 after a whole night indexing. These are VERY small docs with very little information.. THis is what and how i index it: Document d