Re: Slow write performance for Riak CS

2014-07-03 Thread Toby Corkindale
On 4 July 2014 10:20, Matthew MacClary wrote: > Hi all, a Riak CS user named Toby started this discussion about write > performance. I am seeing the exact same behavior in terms of idle CPUs, > network, and disks, but low throughput. Toby do you happen to have any > follow up about settings to imp

RE: Slow write performance for Riak CS

2014-07-03 Thread Matthew MacClary
Hi all, a Riak CS user named Toby started this discussion about write performance. I am seeing the exact same behavior in terms of idle CPUs, network, and disks, but low throughput. Toby do you happen to have any follow up about settings to improve the raw Riak throughput and/or Riak CS throughput?

Re: Slow write performance for Riak CS

2013-05-28 Thread Toby Corkindale
On 29/05/13 06:12, Reid Draper wrote: Hey Toby, Another option is to explore some of the Riak CS PUT configuration parameters, like the internal write concurrency and the buffer size. These can either be changed by editing the app.config, or changing them at run-time in an Erlang shell (via r

Re: Slow write performance for Riak CS

2013-05-28 Thread Reid Draper
Hey Toby, Another option is to explore some of the Riak CS PUT configuration parameters, like the internal write concurrency and the buffer size. These can either be changed by editing the app.config, or changing them at run-time in an Erlang shell (via riak-cs attach). The two parameters are `

Re: Slow write performance for Riak CS

2013-05-27 Thread Toby Corkindale
On 28/05/13 13:11, Jared Morrow wrote: Toby, Can you trying putting data with a second client simultaneously? When people have slow benchmarking, lots of times just using multiple worker/clients helps. Also, what client library are you using? Running up three S3 clients (on separate machines

Re: Slow write performance for Riak CS

2013-05-27 Thread Jared Morrow
Toby, Can you trying putting data with a second client simultaneously? When people have slow benchmarking, lots of times just using multiple worker/clients helps. Also, what client library are you using? Also I meant to mention in my first reply, but Boundary http://boundary.com/worked wonders

Re: Slow write performance for Riak CS

2013-05-27 Thread Toby Corkindale
On 28/05/13 12:46, Toby Corkindale wrote: I'm a bit stumped.. However I do note that the log files seem to have a lot of "monitor busy_dist_port" messages in them.. I'm wondering if that might be related somehow? Just a quick follow-up to say that the busy_dist_port messages went away after ad

Re: Slow write performance for Riak CS

2013-05-27 Thread Toby Corkindale
On 28/05/13 01:41, Jared Morrow wrote: Toby, If you write with multiple clients does it still stick to 9mb/s or does it increase? What is the network link between your client and the Riak CS cluster? On our internal CS cluster we were seeing around 2gb/s read+write at the network level so I kn

Re: Slow write performance for Riak CS

2013-05-27 Thread Jared Morrow
Toby, If you write with multiple clients does it still stick to 9mb/s or does it increase? What is the network link between your client and the Riak CS cluster? On our internal CS cluster we were seeing around 2gb/s read+write at the network level so I know CS can take the speeds, so my gut t