Re: Maximum index file size

2009-10-23 Thread Felipe Lobo
Hi, interesting discussion. Supose my index now has 1 TB. I splitted into 16 hds (65GB per hd) in the same machine with 16 cores. Use parallelmultisearch it's a good idea for this structure?? Results wil be fast?? Is there a better solution for this structure? thanks, On Fri, Oct 23, 2009 at 9:33

Re: Maximum index file size

2009-10-23 Thread Toke Eskildsen
On Fri, 2009-10-23 at 08:49 +0200, Jake Mannix wrote: > One of the big problems you'll run into with this index size is that > you'll never have enough RAM to give your OS's IO cache enough room to keep > much of this index in memory, so you're going to be seeking in this monster > file a lot. [.

Re: Maximum index file size

2009-10-22 Thread Jake Mannix
c) size of index file (with sensible search > times) > > --Hrishi > > -Original Message- > From: Jake Mannix [mailto:jake.man...@gmail.com] > Sent: Friday, October 23, 2009 11:09 AM > To: java-user@lucene.apache.org > Subject: Re: Maximum index file size > > On

RE: Maximum index file size

2009-10-22 Thread Hrishikesh Agashe
ailto:jake.man...@gmail.com] Sent: Friday, October 23, 2009 11:09 AM To: java-user@lucene.apache.org Subject: Re: Maximum index file size On Thu, Oct 22, 2009 at 10:29 PM, Hrishikesh Agashe < hrishikesh_aga...@persistent.co.in> wrote: > Can I create an index file with very large size, like 1 T

Re: Maximum index file size

2009-10-22 Thread Jake Mannix
On Thu, Oct 22, 2009 at 10:29 PM, Hrishikesh Agashe < hrishikesh_aga...@persistent.co.in> wrote: > Can I create an index file with very large size, like 1 TB or so? Is there > any limit on how large index file one can create? Also, will I be able to > search on this 1 TB index file at all? > Leav

Maximum index file size

2009-10-22 Thread Hrishikesh Agashe
I am running Ubuntu 9.04 on 64 bit machine with NAS of 100 TB capacity. JVM is running with 2.5 GB Xmx. Can I create an index file with very large size, like 1 TB or so? Is there any limit on how large index file one can create? Also, will I be able to search on this 1 TB index file at all?

Re: Maximum index file size

2009-10-22 Thread Chris Hostetter
: Subject: Maximum index file size : References: : In-Reply-To: http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even if you change the

Maximum index file size

2009-10-22 Thread Hrishikesh Agashe
Hi, I am running Ubuntu 9.04 on 64 bit machine with NAS of 100 TB capacity. JVM is running with 2.5 GB Xmx. Can I create an index file with very large size, like 1 TB or so? Is there any limit on how large index file one can create? Also, will I be able to search on this 1 TB index file at all