Re: NAS vs SAN vs Server Disk RAID

2010-02-24 Thread Kay Kay
It might be useful to check out katta , from an infrastructure perspective. On 2/24/10 3:54 PM, Andrew Bruno wrote: Hello, I am working with an application that offers its customers their own index, primary two indexes for different needs per customer. As our business is growing and growing,

Re: Is there a way to limit the size of an index?

2010-01-07 Thread Kay Kay
On 1/7/10 11:23 AM, Otis Gospodnetic wrote: Merge factor controls how many segments are merged at once. The default is 10. The maxMergeMB setting sets the max size for a given segment to be included in a merge. I wonder if renaming that to maxSegSizeMergeMB would make it more obvious wha

Re: Is Lucene a good choice for PB scale mailbox search?

2009-11-23 Thread Kay Kay
fulin tang wrote: We are going to add full-text search for our mailbox service . The problem is we have more than 1 PB mails there , and obviously we don't want to add another PB storage for search service , so we hope the index data will be small enough for storage while the search keeps fast .

Re: Reloading RAM Directory from updated FS Directory

2009-06-09 Thread Kay Kay
Have you checked out solr project that provides a service on top of Lucene + caching / warming up facilities similar to what you need. The IndexReaders are expensive ( and are the underlying data source for a given IndexSearcher ) in terms of time and resources , when being opened / created an

Concurrent IndexReader and IndexSearcher behavior

2009-01-30 Thread Kay Kay
Assume I have an index of size 20G and a main memory of 1G. I do the following steps in order. * Open an IndexSearcher on the directory. * Serve Searches from that directory Meanwhile (when the IndexSearcher isstill open on the directory) - the following operations are performed concurrently.

Re: Nightly source builds of Lucene ..

2009-01-22 Thread Kay Kay
Yes - I was referring to the nightly builds of Lucene. For eg- this page - http://lucene.apache.org/java/docs/index.html (search for "Nightly Source Builds" ) contains the link to http://people.apache.org/builds/lucene/java/nightly/ . It might be worth updating this link. For now - as an

Nightly source builds of Lucene ..

2009-01-16 Thread Kay Kay
I am trying to access the nightly lucene builds here at - http://people.apache.org/builds/lucene/java/nightly/ . It does not seem to be available for sometime. Just curious if that is the right source to access the same. ---

Re: IndexSearcher - architecture - shortest possible latency between update of index (via IndexWriter/IndexReader) and querying the same using IndexSearcher

2009-01-08 Thread Kay Kay
9 at 12:27 PM, Kay Kay wrote: Hi- For one of our apps - we are doing a lot of additions and deletions (high frequency) at any given time. Assuming the same index directory under discussion between the writers ( IndexWriter and IndexReader, the latter for deletions) and the readers (IndexS

IndexSearcher - architecture - shortest possible latency between update of index (via IndexWriter/IndexReader) and querying the same using IndexSearcher

2009-01-08 Thread Kay Kay
Hi- For one of our apps - we are doing a lot of additions and deletions (high frequency) at any given time. Assuming the same index directory under discussion between the writers ( IndexWriter and IndexReader, the latter for deletions) and the readers (IndexSearcher to begin with) - we want

Multiple IndexReaders from the same Index Directory - issues with Locks / performance

2008-12-22 Thread Kay Kay
For one of our projects - we were planning to have the system of multiple individual Lucene readers (just read-only instances and no writes whatsoever ) in different physical machines having their IndexReader-s warmed up from the same directory for the indices and working on the same. I was r

Re: Approximate release date for Lucene 2.9

2008-12-19 Thread Kay Kay
t took at least a month to whittle the list down to 0. So it's hard to say? I'd love to see 2.9 out earlyish next year though. Mike Kay Kay wrote: Hi - I am just curious - what is the approximate release target date that we ha

Approximate release date for Lucene 2.9

2008-12-18 Thread Kay Kay
Hi - I am just curious - what is the approximate release target date that we have for Lucene 2.9 ( currently in beta in dev). - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: j