Hi, interesting discussion.
Supose my index now has 1 TB. I splitted into 16 hds (65GB per hd) in the
same machine with 16 cores.
Use parallelmultisearch it's a good idea for this structure?? Results wil be
fast?? Is there a better solution for this structure?
thanks,
On Fri, Oct 23, 2009 at 9:33
On Fri, 2009-10-23 at 08:49 +0200, Jake Mannix wrote:
> One of the big problems you'll run into with this index size is that
> you'll never have enough RAM to give your OS's IO cache enough room to keep
> much of this index in memory, so you're going to be seeking in this monster
> file a lot. [.
c) size of index file (with sensible search
> times)
>
> --Hrishi
>
> -Original Message-
> From: Jake Mannix [mailto:jake.man...@gmail.com]
> Sent: Friday, October 23, 2009 11:09 AM
> To: java-user@lucene.apache.org
> Subject: Re: Maximum index file size
>
> On
ailto:jake.man...@gmail.com]
Sent: Friday, October 23, 2009 11:09 AM
To: java-user@lucene.apache.org
Subject: Re: Maximum index file size
On Thu, Oct 22, 2009 at 10:29 PM, Hrishikesh Agashe <
hrishikesh_aga...@persistent.co.in> wrote:
> Can I create an index file with very large size, like 1 T
On Thu, Oct 22, 2009 at 10:29 PM, Hrishikesh Agashe <
hrishikesh_aga...@persistent.co.in> wrote:
> Can I create an index file with very large size, like 1 TB or so? Is there
> any limit on how large index file one can create? Also, will I be able to
> search on this 1 TB index file at all?
>
Leav
I am running Ubuntu 9.04 on 64 bit machine with NAS of 100 TB capacity. JVM is
running with 2.5 GB Xmx.
Can I create an index file with very large size, like 1 TB or so? Is there any
limit on how large index file one can create? Also, will I be able to search on
this 1 TB index file at all?
: Subject: Maximum index file size
: References:
: In-Reply-To:
http://people.apache.org/~hossman/#threadhijack
Thread Hijacking on Mailing Lists
When starting a new discussion on a mailing list, please do not reply to
an existing message, instead start a fresh email. Even if you change the
Hi,
I am running Ubuntu 9.04 on 64 bit machine with NAS of 100 TB capacity. JVM is
running with 2.5 GB Xmx.
Can I create an index file with very large size, like 1 TB or so? Is there any
limit on how large index file one can create? Also, will I be able to search on
this 1 TB index file at all