Re: Using Cassandra to store files

2011-02-04 Thread sridhar basam
For the number of file the OP has why not just use a traditional filesystem and solr to index the pdf data. You get to search inside of the files for relevant information? Sri On Fri, Feb 4, 2011 at 12:47 PM, buddhasystem wrote: > > Even when storage is in NFS, Cassandra can still be quite us

Re: Using Cassandra to store files

2011-02-04 Thread Aditya Narayan
yes, definitely a database for mapping ofcourse! On Fri, Feb 4, 2011 at 11:17 PM, buddhasystem wrote: > > Even when storage is in NFS, Cassandra can still be quite useful as a file > catalog. Your physical storage can change, move etc. Therefore, it's a good > idea to provide mapping of logical n

Re: Using Cassandra to store files

2011-02-04 Thread buddhasystem
Even when storage is in NFS, Cassandra can still be quite useful as a file catalog. Your physical storage can change, move etc. Therefore, it's a good idea to provide mapping of logical names to physical store points (which in fact can be many). This is a standard technique used in mass storage.

Re: Using Cassandra to store files

2011-02-04 Thread Aditya Narayan
    Cardiff > brendan.po...@new-law.co.uk > 029 2078 4283 > www.new-law.co.uk > > > > > From: Daniel Doubleday [mailto:daniel.double...@gmx.net] > Sent: 03 February 2011 17:21 > To: user@cassandra.apache.org > Subject: Re:

Re: Using Cassandra to store files

2011-02-04 Thread Daniel Doubleday
; brendan.po...@new-law.co.uk > 029 2078 4283 > www.new-law.co.uk > > > > > > From: Daniel Doubleday [mailto:daniel.double...@gmx.net] > Sent: 03 February 2011 17:21 > To: user@cassandra.apache.org > Subject: Re: Using Cassandra to store files &g

RE: Using Cassandra to store files

2011-02-04 Thread Brendan Poole
ay Cardiff brendan.po...@new-law.co.uk 029 2078 4283 www.new-law.co.uk -Original Message- From: buddhasystem [mailto:potek...@bnl.gov] Sent: 03 February 2011 15:03 To: cassandra-u...@incubator.apache.org Subject: Re: Using Cassandra to store files CouchDB -- View this mes

RE: Using Cassandra to store files

2011-02-04 Thread Brendan Poole
www.new-law.co.uk From: Daniel Doubleday [mailto:daniel.double...@gmx.net] Sent: 03 February 2011 17:21 To: user@cassandra.apache.org Subject: Re: Using Cassandra to store files Hundreds of thousands doesn't sound too bad. Good old NFS would do with

Re: Using Cassandra to store files

2011-02-03 Thread Daniel Doubleday
Hundreds of thousands doesn't sound too bad. Good old NFS would do with an ok directory structure. We are doing this. Our documents are pretty small though (a few kb). We have around 40M right now with around 300GB total. Generally the problem is that much data usually means that cassandra beco

Re: Using Cassandra to store files

2011-02-03 Thread Victor Kabdebon
Dear Brendan, I would really be interested by your findings too. I need a system to store various documents, I am thinking of Cassandra (that I am already using) or using a second type of database or any other system. Maybe like dan suggested, using mogilefs. Thank you, Victor Kabdebon http://www

Re: Using Cassandra to store files

2011-02-03 Thread Dan Kuebrich
> > > CouchDB > That's not what document-oriented means! (har har) I don't know all the details of your case, but with serving static files I suspect you could do ok with something that has a much smaller memory/cpu footprint as you won't have as great of write throughput / read latency concerns.

Re: Using Cassandra to store files

2011-02-03 Thread buddhasystem
CouchDB -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Using-Cassandra-to-store-files-tp5988698p5989122.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.