We have data in compound files and we use Lucene as primary database. Its 
working great and much faster with millions of records. The only issue, I face 
is with sorting. Lucene sorting consumes good amount of memory. I don't know 
much about the MySQL/PostgreSQL database, and how they behave with millions of 
records but i guess their sorting memory consumption would be less.  

It would be great, If Lucene has the ability to do backups / replication. I 
don't know how to modify/use the solr script.  

Regards
Ganesh


----- Original Message ----- 
From: "Otis Gospodnetic" <otis_gospodne...@yahoo.com>
To: <java-user@lucene.apache.org>; <gu...@bartolucci.org>
Sent: Wednesday, January 20, 2010 10:45 AM
Subject: Re: Lucene as a primary datastore


> You are not alone, Guido.  It's a good question.  In my experience, Lucene is 
> as stable as MySQL/PostgreSQL in terms of its ability to hold your data and 
> not corrupt it.  Of course, even with the most expensive databases, you'd 
> want to make backups.  The same goes with Lucene.  Nowadays, one way people 
> make "backups" is via replication. :)  Solr users thus often get backups for 
> free, as do people who put copies of their data on file systems like HDFS, 
> which tend to have replication turned on.
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
> 
> 
> 
> ----- Original Message ----
>> From: Guido Bartolucci <guido.bartolu...@gmail.com>
>> To: java-user@lucene.apache.org
>> Sent: Tue, January 19, 2010 10:58:36 PM
>> Subject: Lucene as a primary datastore
>> 
>> I know that the primary use case for Lucene is as an index of data
>> that can be reconstructed (e.g., from a relational database or from
>> spidering your corporate intranet).
>> 
>> But, I'm curious if anyone uses Lucene as their primary datastore for
>> their gold data. Is it good enough?
>> 
>> Would anyone consider (or do people already) store data in Lucene
>> that, if it was lost, would destroy their business? And no, I'm not
>> suggesting that you don't back up this data, I'm just curious if there
>> are problems with using Lucene in this way. Are there subtle
>> corruptions that might show up in Lucene that wouldn't show up in
>> Oracle or MySQL?
>> 
>> I'm considering using Lucene in this way but I haven't been able to
>> find any documentation describing this use case. Are there any studies
>> of Lucene vs MySQL running for N years comparing the corruptions and
>> recovery times?
>> 
>> Am I just ignorant and scared of Lucene and too trusting of Oracle and MySQL?
>> 
>> Thanks.
>> 
>> -guido.
>> 
>> (BTW, I did find a similar question asked back in 2007 in the archives
>> but it doesn't really answer my question)
>> 
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: java-user-h...@lucene.apache.org
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
> For additional commands, e-mail: java-user-h...@lucene.apache.org
>
Send instant messages to your online friends http://in.messenger.yahoo.com

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to