Re: Riak connection pool silent disconnection

2012-10-11 Thread Mikhail Kuznetsov
Yes, I return connection to pool after query. Pool have 30 workers and most of operations is single put. Ulimit in system is equal to 2048. We just started, we store about 200-300 Mb of data on all cluster. We have about terabyte of free space on server disks. Servers mostly stand by and waiting

Re: Riak on Azure - error starting

2012-10-11 Thread Jon Glick
Hey Edo, could you attach your /etc/riak/app.conf & /etc/riak/vm.args file? Thanks On Thu, Oct 11, 2012 at 2:30 AM, Edo van Asseldonk < edovanasseld...@hotmail.com> wrote: > I'm trying to install Riak on Azure, following this guide: > > > http://docs.basho.com/riak/latest/tutorials/installation/I

Riak on Azure - error starting

2012-10-11 Thread Edo van Asseldonk
I'm trying to install Riak on Azure, following this guide:http://docs.basho.com/riak/latest/tutorials/installation/Installing-on-Windows-Azure/But after logging in with putty, and typing in this command:curl -s https://raw.github.com/glickbot/riak_on_azure/master/azure_install_riak.sh | shI get

Re: Riak performance problems when LevelDB database grows beyond 16GB

2012-10-11 Thread Evan Vigil-McClanahan
Can you attach the eleveldb portion of your app.config file? Configuration problems, especially max_open_files being too low, can often cause issues like this. If it isn't sensitive, the whole app.config and vm.args files are also often helpful. On Thu, Oct 11, 2012 at 9:12 AM, wrote: > Hello,

Fastest write to riak

2012-10-11 Thread David Montgomery
Hi, I am using the python riak api and upon stress testing I would have had a death spiral but my riak cluster was not tuned. I will now set the bucket N to 2 e.g. test_bucket.set_n_val(2) Now what is left is w and dw. I would like the option as least getting that is most 1 write occurred. Al

Re: Riak connection pool silent disconnection

2012-10-11 Thread Mike Oxford
I think the key may lie here ",{checkout,false,5000}" Are you releasing your connections back to the pool? Is your throughput greater than the system can handle due to limited connection pool sizes? What is your ulimit set to (ulimit -n) ... maybe you're running out of FD's? -mox On Wed,

Re: Riak riak_kv_vnode worker pool crashed

2012-10-11 Thread Mikhail Kuznetsov
We use localhost:8087 for connection. I take this port number from example code in readme to erlang protobuffs client. I guess if it is port for ring coordination we would never get several days of proper response for our queries from it. -- Sincerely yours, Mikhail Kuznetsov When best practi

Re: Riak riak_kv_vnode worker pool crashed

2012-10-11 Thread Mike Oxford
Check that you have your ports correct. If you connect your client up to the ring distribution ports you can get these kinds of errors. -mox On Wed, Oct 10, 2012 at 10:29 PM, Mikhail Kuznetsov < kuznetsov.m...@gmail.com> wrote: > I deploy a test stand for server app demo for clients. Riak 1.2.0

Listing keys again

2012-10-11 Thread Daniel Iwan
I hope someone could shed some light on this issue Part of our dev code is using Java RiakClient like this KeySource fetched = getRiakClient().listKeys(bucket); while (fetched.hasNext()) { result.add(fetched.next().toStringUtf8()); } where getRiakClient() returns instance of com.basho.riak.p

Riak performance problems when LevelDB database grows beyond 16GB

2012-10-11 Thread Jan.Evangelista
Hello, I am writing a new application and I am testing it on a cluster with 4 Riak nodes (16 GM RAM, 2 x i3 3.4GHz - 2 cores). The application is tested with the expected load of 1000 requests/second, 90% of the requests cause a Riak read and  write of a new key. The problem is that the performa

Re: Riak JAVA Client Performance

2012-10-11 Thread Guido Medina
Hi Pavel, I'm not an expert with the pool size, but depending on your average key size and nodes you could tune it to your needs, regarding the client, a single shared client instance will suffice, there is a retrier parameter which says how many times Riak will retry your operation before

Re: Riak JAVA Client Performance

2012-10-11 Thread Pavel Kogan
Thanks Guido, Pawel, I will try using HAProxy + holding N concurrent connections on the client side. I want clear for myself some point about concurrent connections: 1) What is reasonable limit of concurrent connections? 2) Concurrent connections = separate generated pbc clients or single shared p