Re: Storing files in blob into Cassandra

2011-06-23 Thread AJ
On 6/22/2011 11:43 PM, Sasha Dolgy wrote: maybe you want to spend a few minutes reading about Haystack over at facebook to give you some ideas... https://www.facebook.com/note.php?note_id=76191543919 Not saying what they've done is the right way... just sayin' Thanks for the tip Sasha; will d

Re: Storing files in blob into Cassandra

2011-06-23 Thread Don Ledford
Exactly right - I wrote BlobInputStream and BlobOutputStream classes to go with a Blob class. I use 1MB for the block size, but I haven't done any performance testing. I went small to favor low memory and bandwidth foot prints. I'd, of course, be very interested in any performance tests. On

Re: Storing files in blob into Cassandra

2011-06-23 Thread Damien Picard
>I have a simple blob class over the top of this which handles input and output streaming so reads/writes are only one column at a >time Thank you for the tips. I think I will do the same ; for this time, I've developped a simple version which store the entire file in one column, but I've already

Re: Storing files in blob into Cassandra

2011-06-22 Thread Sasha Dolgy
maybe you want to spend a few minutes reading about Haystack over at facebook to give you some ideas... https://www.facebook.com/note.php?note_id=76191543919 Not saying what they've done is the right way... just sayin' On Thu, Jun 23, 2011 at 6:29 AM, AJ wrote: > > I was thinking of doing the s

Re: Storing files in blob into Cassandra

2011-06-22 Thread AJ
On 6/22/2011 1:07 AM, Damien Picard wrote: Hi, I have to store some files (Images, documents, etc.) for my users in a webapp. I use Cassandra for all of my data and I would like to know if this is a good idea to store these files into blob on a Cassandra CF ? Is there some contraindications, o

Re: Storing files in blob into Cassandra

2011-06-22 Thread Don Ledford
On 06/22/2011 01:23 AM, Damien Picard wrote: >store your images / documents / etc. somewhere and reference them >in Cassandra. That's the consensus that's been bandied about on this >list quite frequently I store large files in Cassandra using columns for file blocks. I have a simple blo

Re: Storing files in blob into Cassandra

2011-06-22 Thread mcasandra
some tests. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Storing-files-in-blob-into-Cassandra-tp6503165p6505188.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: Storing files in blob into Cassandra

2011-06-22 Thread Damien Picard
In this case, the load balancer has to detect (or is configured) that the server is down and does not route request to this one anymore. 2011/6/22 aaron morton > If the Cassandra JVM is down, Tomcat and Httpd will continue to handle > requests. And Pelops will redirect these requests to another

Re: Storing files in blob into Cassandra

2011-06-22 Thread aaron morton
> If the Cassandra JVM is down, Tomcat and Httpd will continue to handle > requests. And Pelops will redirect these requests to another Cassandra node > on another server (maybe am I wrong with this assertion). I was thinking of the server been turned off / broken / rebooting / disconnected fro

Re: Storing files in blob into Cassandra

2011-06-22 Thread Damien Picard
2011/6/22 aaron morton > I think I have to detail my configuration. On every server of my cluster, I > deploy : > - a Cassandra node > - a Tomcat instance > - the webapp, deployed on Tomcat > - Apache httpd, in front of Tomcat with mod_jakarta > > > You will have a bunch of services on the ma

Re: Storing files in blob into Cassandra

2011-06-22 Thread aaron morton
> I think I have to detail my configuration. On every server of my cluster, I > deploy : > - a Cassandra node > - a Tomcat instance > - the webapp, deployed on Tomcat > - Apache httpd, in front of Tomcat with mod_jakarta You will have a bunch of services on the machine competing with each oth

Re: Storing files in blob into Cassandra

2011-06-22 Thread Damien Picard
>store your images / documents / etc. somewhere and reference them >in Cassandra. That's the consensus that's been bandied about on this >list quite frequently Thank you for your answers. I think I have to detail my configuration. On every server of my cluster, I deploy : - a Cassandra node -

Re: Storing files in blob into Cassandra

2011-06-22 Thread Sylvain Lebresne
Let's be more precise in saying that this all depends on the expected size of the documents. If you know that the documents will be on the few hundreds kilobytes mark on average and no more than a few megabytes (say < 5MB, even though there is no magic number), then storing them as blob will work p

Re: Storing files in blob into Cassandra

2011-06-22 Thread Sasha Dolgy
http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Storing-photos-images-docs-etc-td6078278.html Of significance from that link (which was great until feeling lucky was removed...): Google of terms cassandra large files + feeling lucky http://www.google.com/search?q=cassandra+large+

Storing files in blob into Cassandra

2011-06-22 Thread Damien Picard
Hi, I have to store some files (Images, documents, etc.) for my users in a webapp. I use Cassandra for all of my data and I would like to know if this is a good idea to store these files into blob on a Cassandra CF ? Is there some contraindications, or special things to know to achieve this ? Tha