Clients, protocols and TSockets

2010-08-28 Thread Kevin Irwig
Hi, performance wise, in a multi-threaded environment, should each Cassandra.Client have it's own new TBinaryProtocol and TSocket? (I'm using java) Or can many clients be created with the same protocol object? Thanks in advance, Kevin.

Re: Read before Write

2010-08-28 Thread Aaron Morton
If you are reading and making decisions about what to write just remember there are no transactions. You are essentially running at a Read Uncommitted level of transaction isolation, with regard of batch mutations (a mutation for a single row is atomic). If you can it may be less headache to wr

Re: Cassandra & HAProxy

2010-08-28 Thread Mark
On 8/28/10 2:44 PM, Benjamin Black wrote: On Sat, Aug 28, 2010 at 2:34 PM, Anthony Molinaro wrote: I think maybe he thought you meant put a layer between cassandra internal communication. No, I took the question to be about client connections. There's no problem balancing client connection

Re: Benchmarking Cassandra 0.6.5 with YCSB client ... drags to a halt

2010-08-28 Thread Fernando Racca
thanks for the updates, i'm going to increase memory for the nodes. as for the remote latency, i'm puzzled On 29 August 2010 00:54, Benjamin Black wrote: > That means you only have a 1G heap. It's no surprise it dies (most > likely OOM; CMS runs are not inherently bad). Don't see immediately >

Re: Cassandra & HAProxy

2010-08-28 Thread Joe Stump
On Aug 28, 2010, at 12:29 PM, Mark wrote: > Also, what would be a good way of monitoring the health of the cluster? We use Ganglia. I believe failover is usually built into clients. Not sure why using HAProxy or LVS wouldn't be a good option though. I used to use it with MySQL slaves with much

Re: Benchmarking Cassandra 0.6.5 with YCSB client ... drags to a halt

2010-08-28 Thread Benjamin Black
That means you only have a 1G heap. It's no surprise it dies (most likely OOM; CMS runs are not inherently bad). Don't see immediately why you are seeing the remote latency go up that high, but it is unlikely yo be a Cassandra problem. On Sat, Aug 28, 2010 at 4:01 PM, Fernando Racca wrote: > ca

Re: Benchmarking Cassandra 0.6.5 with YCSB client ... drags to a halt

2010-08-28 Thread Fernando Racca
cassandra.in.sh is default, just changed the jmx port Storage.conf Benchmark Cluster true true org.apache.cassandra.locator.RackUnawareStrategy 2 org.apache.cassandra.locator.EndPointSnitch org.apache.cassandra.auth.AllowAllAuthenticator org.apache.cas

Re: Benchmarking Cassandra 0.6.5 with YCSB client ... drags to a halt

2010-08-28 Thread Benjamin Black
cassandra.in.sh? storage-conf.xml? output of iostat -x while this is going on? turn GC log level to debug? On Sat, Aug 28, 2010 at 2:02 PM, Fernando Racca wrote: > Hi, > I'm currently executing some benchmarks against 0.6.5, which i plan to > compare against 0.7-beta1, using the YCSB client > I'm

Re: Cassandra & HAProxy

2010-08-28 Thread Benjamin Black
On Sat, Aug 28, 2010 at 2:34 PM, Anthony Molinaro wrote: > I think maybe he thought you meant put a layer between cassandra internal > communication. No, I took the question to be about client connections. > There's no problem balancing client connections with > haproxy, we've been pushing sever

Re: Cassandra & HAProxy

2010-08-28 Thread Benjamin Black
munin is the simplest thing. There are numerous JMX stats of interest. As a symmetric distributed system, you should not expect to monitor Cassandra like you would a web server. Intelligent clients use connection pools and react to current node behavior in making choices of where to send request

Re: Cassandra & HAProxy

2010-08-28 Thread Anthony Molinaro
I think maybe he thought you meant put a layer between cassandra internal communication. There's no problem balancing client connections with haproxy, we've been pushing several billion requests per month through haproxy to cassandra. we use mode tcp balance leastconn server local 127.0.0.

Re: Cassandra & HAProxy

2010-08-28 Thread Benjamin Black
Because you create a bottleneck at the HAProxy and because the presence of the proxy precludes clients properly backing off from nodes returning errors. The proper approach is to have clients maintain connection pools with connections to multiple nodes in the cluster, and then to spread requests a

Benchmarking Cassandra 0.6.5 with YCSB client ... drags to a halt

2010-08-28 Thread Fernando Racca
Hi, I'm currently executing some benchmarks against 0.6.5, which i plan to compare against 0.7-beta1, using the YCSB client I'm experiencing some strange behaviour when running a small 2 nodes cluster using OrderPreservingPartitioner. Does anybody have any experience on using the client to genera

Re: RowMutationVerbHandler.java (line 78) Error in row mutation

2010-08-28 Thread Benjamin Black
Have you tried with beta1 and is there a repro you can put in a bug report in jira? On Sat, Aug 28, 2010 at 11:28 AM, Todd Burruss wrote: > Trunk > > > > -Original Message- > From: Benjamin Black [...@b3k.us] > Received: 8/28/10 10:05 AM > To: user@cassandra.apache.org [u...@cassandra.apa

Re: Cassandra & HAProxy

2010-08-28 Thread Mark
On 8/28/10 11:20 AM, Benjamin Black wrote: no and no. On Sat, Aug 28, 2010 at 10:28 AM, Mark wrote: I will be loadbalancing between nodes using HAProxy. Is this recommended? Also is there a some sort of ping/health check uri available? Thanks Also, what would be a good way of monitoring

Re: RowMutationVerbHandler.java (line 78) Error in row mutation

2010-08-28 Thread Todd Burruss
Trunk -Original Message- From: Benjamin Black [...@b3k.us] Received: 8/28/10 10:05 AM To: user@cassandra.apache.org [u...@cassandra.apache.org] Subject: Re: RowMutationVerbHandler.java (line 78) Error in row mutation Todd, Are you using beta1 or trunk code? b On Fri, Aug 27, 2010 at

Re: Cassandra & HAProxy

2010-08-28 Thread Mark
On 8/28/10 11:20 AM, Benjamin Black wrote: no and no. On Sat, Aug 28, 2010 at 10:28 AM, Mark wrote: I will be loadbalancing between nodes using HAProxy. Is this recommended? Also is there a some sort of ping/health check uri available? Thanks any reason on why loadbalancing client connec

Re: Cassandra & HAProxy

2010-08-28 Thread Benjamin Black
no and no. On Sat, Aug 28, 2010 at 10:28 AM, Mark wrote: >  I will be loadbalancing between nodes using HAProxy. Is this recommended? > > Also is there a some sort of ping/health check uri available? > > Thanks >

Cassandra & HAProxy

2010-08-28 Thread Mark
I will be loadbalancing between nodes using HAProxy. Is this recommended? Also is there a some sort of ping/health check uri available? Thanks

Re: RowMutationVerbHandler.java (line 78) Error in row mutation

2010-08-28 Thread Benjamin Black
Todd, Are you using beta1 or trunk code? b On Fri, Aug 27, 2010 at 3:58 PM, B. Todd Burruss wrote: > i got the latest code this morning.  i'm testing with 0.7 > > > ERROR [ROW-MUTATION-STAGE:388] 2010-08-27 15:54:58,053 > RowMutationVerbHandler.java (line 78) Error in row mutation > org.apache

Join & Range Query performance

2010-08-28 Thread Christian Decker
I'm wondering what the performance considerations are on Join-like queries. I have a ColumnFamily that holds millions of records (not unusual as I understand) and I want to work on them using Pig and Hadoop. Until now we always fetched all rows in Cassandra and just filtered and worked on them. Th

Re: need help on cassandra client

2010-08-28 Thread Eric Evans
On Sat, 2010-08-28 at 13:00 +0530, cassam read wrote: > I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . > everything (column,super-column, > replication,failover) i tried was successful from cli. > But I am stucked with thrift client. How to access cassandra thrift. > Do i hav

Re: need help on cassandra client

2010-08-28 Thread Jonathan Ellis
you need thrift before you can use any of the clients built on top of it. http://wiki.apache.org/cassandra/InstallThrift On Sat, Aug 28, 2010 at 2:30 AM, cassam read wrote: > Hi guys > I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . > everything (column,super-column, > repli

Re: Cassandra summit video downloads?

2010-08-28 Thread Phil Stanhope
Thanks ... The format and download links did the trick -phil On Aug 28, 2010, at 7:38 AM, Jeremy Hanna wrote: > Looks like below each video (on blip.tv) there's a download link - downloads > to a flash video (.flv) file. > > On Aug 28, 2010, at 5:33 AM, Phil Stanhope wrote: > >> I'm about to

Re: Cassandra summit video downloads?

2010-08-28 Thread samal gorai
http://www.riptano.com/blog/slides-and-videos-cassandra-summit-2010

Re: Cassandra summit video downloads?

2010-08-28 Thread Jeremy Hanna
Looks like below each video (on blip.tv) there's a download link - downloads to a flash video (.flv) file. On Aug 28, 2010, at 5:33 AM, Phil Stanhope wrote: > I'm about to be on a series of long plane flights ... is there way to > download the videos from the summit for offline viewing?

Cassandra summit video downloads?

2010-08-28 Thread Phil Stanhope
I'm about to be on a series of long plane flights ... is there way to download the videos from the summit for offline viewing?

Re: Follow-up post on cassandra configuration with some experiments on GC tuning

2010-08-28 Thread Peter Schuller
> Before I applied these changes the young gen and the survivor space > were very spiky. Now they both seem very low all the time. As you see > from my screen shot, before these changes my JVM memory would make > large saw tooths, now all three pools young, eden, perm seem smoother. I'm not sure w

need help on cassandra client

2010-08-28 Thread cassam read
Hi guys I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . everything (column,super-column, replication,failover) i tried was successful from cli. But I am stucked with thrift client. How to access cassandra thrift. Do i have to compile thrift pkg for perl or I can directly used