Re: Defrag

2011-03-03 Thread Peter Schuller
> Potential sources of simultaneous disk write : > > - Memtable flushing > - SSTable compaction/anticompaction > - SSTable streaming > - Commitlog writes (which should be on a different drive from data per > best practices anyway..) Honestly though, last time I measured the effects of multiple str

Re: Issues connecting from outside of localhost

2011-03-03 Thread Karl Hiramoto
On 02/03/2011 17:57, David McNelis wrote: In case anyone is interested. Our problem revolved around one machine having the phpcassa thrift patch, and the other did not. Its resolved now. Which patch? I think there is a difference between tag v0.7.a.3 and the current HEAD of master. I

apache.org down?

2011-03-03 Thread Donal Zang
rt -- Donal Zang

Re: apache.org down?

2011-03-03 Thread Sasha Dolgy
unresponsive... : ) 2011/3/3 Donal Zang : > rt > > -- > Donal Zang

RE: dropping keyspace in cassandra

2011-03-03 Thread Sagar Kohli
Hi, Probably I got the answer, it is Tombstones in Cassandra. It is something like soft delete.. Pl correct me if m wrong Regards sagar -Original Message- From: Sagar Kohli [mailto:sagar.ko...@impetus.co.in] Sent: Thursday, March 03, 2011 11:44 AM To: user@cassandra.apache.org Subject: R

Re: dropping keyspace in cassandra

2011-03-03 Thread Sylvain Lebresne
Before a keyspace is dropped, a snapshot is taken (by security). It is your job to remove the snapshot manually. (the tombstones have no play here) -- Sylvain On Thu, Mar 3, 2011 at 12:36 PM, Sagar Kohli wrote: > Hi, > > Probably I got the answer, it is Tombstones in Cassandra. > It is somethin

RE: dropping keyspace in cassandra

2011-03-03 Thread Sagar Kohli
Thanks Salvain to correct me, Have one more query, what is the location(default) of snapshot created by security?? ~sagar From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Thursday, March 03, 2011 5:22 PM To: user@cassandra.apache.org Cc: Sagar Kohli Subject: Re: dropping keyspace in ca

Re: dropping keyspace in cassandra

2011-03-03 Thread Sylvain Lebresne
On Thu, Mar 3, 2011 at 1:01 PM, Sagar Kohli wrote: > Thanks Salvain to correct me, Have one more query, what is the > location(default) of snapshot created by security?? > That should be within your data directory, in a directory whose name is the current time of the snapshot (aka drop in this c

Re: How to use JConsole to connect to a Cassandra cluster in Amazon EC2?

2011-03-03 Thread Matt Kennedy
If you edit the $CASSANDRA_HOME/conf/cassandra-env.sh script, you should be able to set up ssl for the JMX connection. That should allow you to do a direct connection from a locally running JConsole to the JMX port on the public IP of your EC2 instance. On Wed, Mar 2, 2011 at 9:10 PM, Sameer Faroo

Re: Advice on a design

2011-03-03 Thread Vodnok
Ok seems that i'll use Solr (with dedicated Cassandra) for search I've readed this article : http://ria101.wordpress.com/2010/02/22/cassandra-randompartitioner-vs-orderpreservingpartitioner/on RP vs OPP... Here is my case docs_shared{ //docs shared by users ordered by time 'time:id_user:id

Re: Advice on a design

2011-03-03 Thread Vodnok
Ok seems that i'll use Solr (with dedicated Cassandra) for search I've readed this article : http://ria101.wordpress.com/2010/02/22/cassandra-randompartitioner-vs-orderpreservingpartitioner/ on RP vs OPP... Here is my case docs_shared{ //docs shared by users ordered by time 'time:id_user:i

Re: Advice on a design

2011-03-03 Thread Jeremy Hanna
Have you considered using Solandra (Solr/Lucene + Cassandra) - https://github.com/tjake/Lucandra#readme ? There is a #solandra channel on freenode if you had any questions as well. On Mar 3, 2011, at 8:00 AM, Vodnok wrote: > Ok seems that i'll use Solr (with dedicated Cassandra) for search >

Re: How to use JConsole to connect to a Cassandra cluster in Amazon EC2?

2011-03-03 Thread Frank Duan
We found this was very helpful: http://simplygenius.com/2010/08/jconsole-via-socks-ssh-tunnel.html (http://wiki.apache.org/cassandra/Operations#Monitoring) - fduan On Wed, Mar 2, 2011 at 9:10 PM, Sameer Farooqui wrote: > I want to use JConsole to look at the Cassandra's MBean's attributes (like

cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread A J
In PropertyFileSnitch is cassandra-rack.properties or cassandra-topology.properties file used ? Little confused by the stmt: PropertyFileSnitch determines the location of nodes by referring to a user-defined description of the network details located in the property file cassandra-rack.properties.

Error when bringing up nodes during failure testing

2011-03-03 Thread mcasandra
Whenever I do failure testing I see this error message and then cassandra process exits. This is what I am doing: 1. 3 node cluster. CF of RF=3, W=QUORUM and R=QUORUM 2. Execute client code in a loop which just reads data from CF in while loop. 2. Bring one node down (Node C). Everything ok. C

Re: cassandra as user-profile data store

2011-03-03 Thread Dave Gardner
Dave We are in production with 0.6. We started with this and haven't had time to figure out how to upgrade smoothly. It's on the horizon though; there's loads of features we really could do with in 0.7. In terms of strategy, we don't currently follow Tyler's suggestions. I can't see any reason wh

question about replicas & dynamic response to load

2011-03-03 Thread Shaun Cutts
Hello, In our project our usage pattern is likely to be quite variable -- high for a a few days, then lower, etc could vary as much (or more) as 10x from peak to "non-peak". Also, much of our data is immutable -- but there is a considerable amount of it -- perhaps in the single digit TBs. Final

Re: cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread Jonathan Ellis
Did you try "ls conf/" ? On Thu, Mar 3, 2011 at 11:27 AM, A J wrote: > In PropertyFileSnitch is cassandra-rack.properties or > cassandra-topology.properties file used ? > > Little confused by the stmt: > PropertyFileSnitch determines the location of nodes by referring to a > user-defined descript

Re: cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread A J
Yes, that has topology and not rack. conf/access.properties conf/log4j-server.properties conf/cassandra-env.sh conf/log4j-tools.properties conf/cassandra-topology.properties conf/passwd.properties conf/cassandra.yaml conf/README.txt On Thu, Mar 3, 2011

Cassandra 0.7.2 - Enable/Disable HH via JMX (Jconsole)

2011-03-03 Thread Narendra Sharma
I am unable to enable/disable HH via JMX (JConsole). Even though the load is on and read/writes happening, I don't see "operations" component on Jconsole. To clarify further, I see only Jconsole->MBeans->org.apache.cassandra.db.StorageProxy.Attributes. I don't see Jconsole->MBeans->org.apache.cass

Re: Cassandra 0.7.2 - Enable/Disable HH via JMX (Jconsole)

2011-03-03 Thread Ching-Cheng Chen
The HintedHandoffEnabled attribute is read/write. You can always set it to true/false to enable/disable HH. Regards, Chen www.evidentosftware.com On Thu, Mar 3, 2011 at 1:47 PM, Narendra Sharma wrote: > I am unable to enable/disable HH via JMX (JConsole). > > Even though the load is on and re

Re: Storing photos, images, docs etc.

2011-03-03 Thread mcasandra
Has anyone heard about lustre distributed file system? I am wondering if it will work well where keep the metadata in Cassandra and images in Lustre. I looked at MogileFS but not too sure about it's support. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.n

Network Topology Strategy error

2011-03-03 Thread A J
using latest cassandra (0.7.2). I want to try out Network Topology Strategy. Following is related setting in cassandra.yaml endpoint_snitch: org.apache.cassandra.locator.PropertyFileSnitch I have four nodes. Set them accordingly in ./conf/cassandra-topology.properties: 10.252.219.224=DC2:RAC1 10.

RE: Storing photos, images, docs etc.

2011-03-03 Thread Weili McClenahan
How Amazon implemented its S3? Seems to me that you are going to implement something like S3 - data storage system. I have the same requirement - need to store hugh amount of large files (pdf, image, zip, video, audio...). Another question: how about HDFS? -Original Message- From: mcasa

Re: Storing photos, images, docs etc.

2011-03-03 Thread Edward Capriolo
On Thu, Mar 3, 2011 at 2:49 PM, mcasandra wrote: > Has anyone heard about lustre distributed file system? I am wondering if it > will work well where keep the metadata in Cassandra and images in Lustre. > > I looked at MogileFS but not too sure about it's support. > > -- > View this message in con

Re: Storing photos, images, docs etc.

2011-03-03 Thread A J
why would you keep metadata in cassandra ? Even for millions of documents, metadata would be very small, mysql/postgres should suffice. Luster ofcourse is well known and widely used along with glusterfs. Luster I think requires kernel modifications and will be much more complex. Also it is easier

UseCompressedStrings

2011-03-03 Thread Timo Nentwig
Did somebody try -XX:+UseCompressedStrings with cassandra? Sounds very promising and reasonable.

Re: Network Topology Strategy error

2011-03-03 Thread Jonathan Ellis
you need to specify per-DC replicas w/ NTS in strategy_options, instead of using replication_factor On Thu, Mar 3, 2011 at 1:52 PM, A J wrote: > using latest cassandra (0.7.2). I want to try out Network Topology Strategy. > > Following is related setting in cassandra.yaml > endpoint_snitch: org.a

Re: Storing photos, images, docs etc.

2011-03-03 Thread mcasandra
Well it's not just metadata that I need to store but also Username, profiles, followers etc. What I meant was store the location of the images along with other information that I described above. And when user queries them then pull it from the file sytem. Most of the high volume sites (facebook,

Re: Storing photos, images, docs etc.

2011-03-03 Thread Dan Kuebrich
It's still maintained: https://github.com/mogilefs/ . I don't have a good sense of the community, though we did use it at my last job. On Thu, Mar 3, 2011 at 3:44 PM, mcasandra wrote: > Well it's not just metadata that I need to store but also Username, > profiles, > followers etc. What I meant

Re: Storing photos, images, docs etc.

2011-03-03 Thread Robert Coli
On Thu, Mar 3, 2011 at 1:02 PM, Dan Kuebrich wrote: > It's still maintained: https://github.com/mogilefs/ .  I don't have a good > sense of the community, though we did use it at my last job. #mogilefs on freenode contains one of the most solicitous and helpful project maintainers I have ever hav

Re: Network Topology Strategy error

2011-03-03 Thread A J
Thanks. It worked when I changed as you suggested to: create keyspace ks1 with strategy_options = [{DC1:1, DC2:1}] and placement_strategy='org.apache.cassandra.locator.NetworkTopologyStrategy'; Something that I am observing: The replicas are always put in the first node on the other DC. (So if the

Re: Network Topology Strategy error

2011-03-03 Thread Jonathan Ellis
Sounds like your nodes are not evenly spaced around the ring in each dc. On Thu, Mar 3, 2011 at 4:09 PM, A J wrote: > Thanks. > It worked when I changed as you suggested to: create keyspace ks1 with > strategy_options = [{DC1:1, DC2:1}] and > placement_strategy='org.apache.cassandra.locator.Netwo

Re: UseCompressedStrings

2011-03-03 Thread Edward Capriolo
On Thu, Mar 3, 2011 at 3:21 PM, Timo Nentwig wrote: > Did somebody try -XX:+UseCompressedStrings with cassandra? Sounds very   > promising and reasonable. Would be nice except in 0.7.0 we are using mostly byte buffers now. Although the column family name is still a String.

RE: question about replicas & dynamic response to load

2011-03-03 Thread Dan Hendry
To some extent, the boot-strapping problem will be an issue with most solutions: the data has to be duplicated from somewhere. Bootstrapping should not cause much performance degradation unless you are already pushing capacity limits. It's the decommissioning problem which makes Cassandra somewhat