Re: lucene scalability questions

2007-01-04 Thread Russ
ed in "lucene in action". Russ Sent wirelessly via BlackBerry from T-Mobile. -Original Message- From: "Peter W." <[EMAIL PROTECTED]> Date: Thu, 4 Jan 2007 14:02:00 To:java-user@lucene.apache.org Subject: Re: lucene scalability questions Mark, My understandin

Re: lucene scalability questions

2007-01-04 Thread Peter W.
Mark, My understanding of Lucene is limited, but the issues seem similar to web server farms in that it comes down to linear scalability by adding more boxes. This means separate machines with their own indexes. Shared filesystems such as NFS work well in smaller environments but experience pro

lucene scalability questions

2007-01-04 Thread Mark Mei
So this question has two parts: 1. How does Lucene scale, exactly? Do we distribute the index to multiple servers somehow? Or is it one index, sitting on some sort of a shared filesystem, shared by all Lucene servers? If it's the latter, the bottleneck will be I/O ... anyway, elaborate on scalabi

Re: Scalability Questions

2006-10-24 Thread Doron Cohen
>> 4) Roughly how large is the index file in comparison to the size of the >> input files? > > It depends on whether you store fields or just index them, plus > there is also a compression (gzip -9 equivalent) option. As an example - index size numbers I saw: when indexing 1M docs of ~20KB of very

Re: Scalability Questions

2006-10-20 Thread Otis Gospodnetic
dnesday, October 18, 2006 3:14:00 PM Subject: Scalability Questions Hello All, Lucene looks very interesting to me. I was wondering if any of you could comment on a few questions: 1) Assuming I use a typical server such as a dual-core dual-processor Dell 2950, about how many files can Lucene

Scalability Questions

2006-10-18 Thread Guerre Bear
Hello All, Lucene looks very interesting to me. I was wondering if any of you could comment on a few questions: 1) Assuming I use a typical server such as a dual-core dual-processor Dell 2950, about how many files can Lucene index and still have a sub-two-second search speed for a simple search