Re: Dynamic Snitch / Read Path Questions

2010-12-17 Thread Daniel Doubleday
> the purpose of your thread is: How far are you away from being I/O > bound (say in terms of % utilization - last column of iostat -x 1 - > assuming you don't have a massive RAID underneath the block device) No my cheap boss didn't want to by me a stack of these http://www.ocztechnology.com/prod

Re: Dynamic Snitch / Read Path Questions

2010-12-14 Thread Peter Schuller
> We are entirely IO-bound. What killed us last week were to many reads > combined with flushes and compactions. Reducing compaction priority helped > but it was not enough. Them main problem why we could not add nodes though > had to do with the quorum reads we are doing: I'm going to respond

Re: Dynamic Snitch / Read Path Questions

2010-12-14 Thread Daniel Doubleday
On Dec 14, 2010, at 2:29 AM, Brandon Williams wrote: > On Mon, Dec 13, 2010 at 6:43 PM, Daniel Doubleday > wrote: > Oh - well but I see that the coordinator is actually using its own score for > ordering. I was only concerned that dropped messages are ignored when > calculating latencies but

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Brandon Williams
On Mon, Dec 13, 2010 at 6:43 PM, Daniel Doubleday wrote: > Oh - well but I see that the coordinator is actually using its own score > for ordering. I was only concerned that dropped messages are ignored when > calculating latencies but that seems to be the case for local or remote > responses. And

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Daniel Doubleday
On 13.12.10 21:15, Brandon Williams wrote: On Sun, Dec 12, 2010 at 10:49 AM, Daniel Doubleday mailto:daniel.double...@gmx.net>> wrote: Hi again. It would be great if someone could comment whether the following is true or not. I tried to understand the consequences of using

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Brandon Williams
On Sun, Dec 12, 2010 at 10:49 AM, Daniel Doubleday wrote: > Hi again. > > It would be great if someone could comment whether the following is true or > not. > I tried to understand the consequences of using > |-Dcassandra.dynamic_snitch=true for the read path |and that's what I came > up with: >

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Daniel Doubleday
Hi Peter I should have started with the why instead of what ... Background Info (I try to be brief ...) We have a very small production cluster (started with 3 nodes, now we have 5). Most of our data is currently in mysql but we want to slowly move the larger tables which are killing our mysql

Re: Dynamic Snitch / Read Path Questions

2010-12-13 Thread Peter Schuller
> 1) If using CL > 1 than using the dynamic snitch will result in a data read > from node with the lowest latency (little simplified) even if the proxy node > contains the data but has a higher latency that other possible nodes which > means that it is not necessary to do load-based balancing on th

Dynamic Snitch / Read Path Questions

2010-12-12 Thread Daniel Doubleday
Hi again. It would be great if someone could comment whether the following is true or not. I tried to understand the consequences of using |-Dcassandra.dynamic_snitch=true for the read path |and that's what I came up with: 1) If using CL > 1 than using the dynamic snitch will result in a dat