Have you seen the "Hot Backups with Lucene" paper available via http://www.manning.com/hatcher3/ ?
Otis -- Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch ----- Original Message ---- > From: Ganesh <emailg...@yahoo.co.in> > To: java-user@lucene.apache.org > Sent: Wed, January 20, 2010 1:13:21 AM > Subject: Re: Lucene as a primary datastore > > We have data in compound files and we use Lucene as primary database. Its > working great and much faster with millions of records. The only issue, I > face > is with sorting. Lucene sorting consumes good amount of memory. I don't know > much about the MySQL/PostgreSQL database, and how they behave with millions > of > records but i guess their sorting memory consumption would be less. > > It would be great, If Lucene has the ability to do backups / replication. I > don't know how to modify/use the solr script. > > Regards > Ganesh > > > ----- Original Message ----- > From: "Otis Gospodnetic" > To: ; > Sent: Wednesday, January 20, 2010 10:45 AM > Subject: Re: Lucene as a primary datastore > > > > You are not alone, Guido. It's a good question. In my experience, Lucene > > is > as stable as MySQL/PostgreSQL in terms of its ability to hold your data and > not > corrupt it. Of course, even with the most expensive databases, you'd want to > make backups. The same goes with Lucene. Nowadays, one way people make > "backups" is via replication. :) Solr users thus often get backups for free, > as > do people who put copies of their data on file systems like HDFS, which tend > to > have replication turned on. > > > > Otis > > -- > > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch > > > > > > > > ----- Original Message ---- > >> From: Guido Bartolucci > >> To: java-user@lucene.apache.org > >> Sent: Tue, January 19, 2010 10:58:36 PM > >> Subject: Lucene as a primary datastore > >> > >> I know that the primary use case for Lucene is as an index of data > >> that can be reconstructed (e.g., from a relational database or from > >> spidering your corporate intranet). > >> > >> But, I'm curious if anyone uses Lucene as their primary datastore for > >> their gold data. Is it good enough? > >> > >> Would anyone consider (or do people already) store data in Lucene > >> that, if it was lost, would destroy their business? And no, I'm not > >> suggesting that you don't back up this data, I'm just curious if there > >> are problems with using Lucene in this way. Are there subtle > >> corruptions that might show up in Lucene that wouldn't show up in > >> Oracle or MySQL? > >> > >> I'm considering using Lucene in this way but I haven't been able to > >> find any documentation describing this use case. Are there any studies > >> of Lucene vs MySQL running for N years comparing the corruptions and > >> recovery times? > >> > >> Am I just ignorant and scared of Lucene and too trusting of Oracle and > >> MySQL? > >> > >> Thanks. > >> > >> -guido. > >> > >> (BTW, I did find a similar question asked back in 2007 in the archives > >> but it doesn't really answer my question) > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > >> For additional commands, e-mail: java-user-h...@lucene.apache.org > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > Send instant messages to your online friends http://in.messenger.yahoo.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
