Re: Adding large files to index

2007-04-25 Thread Daniel Noll
David Xiao wrote: Consider reduce size of per file. Split them into smaller pieces will definitely help indexer working faster. A 50M pure text file is amazing size, very few text files reach that size: 50M. It must be very reasonable if you have to keep all information in such one big file. Wh

RE: Adding large files to index

2007-04-24 Thread David Xiao
? -Original Message- From: Rajendranath, Divya [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 24, 2007 8:55 PM To: java-user@lucene.apache.org Subject: RE: Adding large files to index But, I am facing the problem even with -Xms 256m and -Xmx 1024m. Yes, the file was not added to the index

RE: Adding large files to index

2007-04-24 Thread Rajendranath, Divya
, the index was not responsive (no documents were being added/deleted in the index). What could be the reason for this ? Divya -Original Message- From: David Xiao [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 24, 2007 6:01 PM To: java-user@lucene.apache.org Subject: RE: Adding large

RE: Adding large files to index

2007-04-24 Thread David Xiao
Use java -Xms50m to start your program, that gives a 50M initial heap size. The OutofHeapMemory is because the default heap memory is not enough for your application. -Original Message- From: Divya Rajendranath [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 24, 2007 7:01 PM To: java-use