Re: How to profile a cluster of Riak nodes

2012-08-09 Thread Greg Burd
Amir, I'll add one more major consideration to Ryan's excellent list, check your network for TCP Incast. Every cluster at reasonable scale will have to manage this issue carefully, 20 nodes is more than enough to create this kind of problem (I see it with as few as 9). Here's more information

Re: How to profile a cluster of Riak nodes

2012-08-09 Thread Ryan Zezeski
Amir, Are you using one node to run basho bench? If so, have you tried running multiple basho bench instances on separate nodes (or tried other benchmark tools)? There could be many reasons for your plateau but I would first rule out that your not maxing out the basho bench instance or the node

Re: How to profile a cluster of Riak nodes

2012-08-09 Thread Alexander Sicular
I hate to use your post as an example, Amir, but your post is a perfect example of "according to my benchmark your product did not meet my performance expectations; oh ya, I'm not gonna tell you anything about the benchmark or the environment I was running in." Everybody, please stop doing that.

How to profile a cluster of Riak nodes

2012-08-09 Thread amir ghaffari
Hi there, I have done a scalability benchmark for Riak DBMS and we couldn't scale up the throughput beyond 20 Riak nodes. The benchmarking with Basho_Bench has been run on a 31 node cluster and each node has its own hard disk but the maximum throughput is on 20 nodes. I’d like to understand why R