Riak performance on GET operations (was "LevelDB read performance)

2012-07-28 Thread Parnell Springmeyer
Hi everyone! I figured out what my bottleneck was - HTTP API + sequential (as opposed to concurrent) GET requests. I wrote a simple Erlange Cowboy handler that uses a worker pool OTP application I built to make concurrent GETs using the PBC api. My Python web app makes a call to the handler an

Java client key existence

2012-07-28 Thread Ukyo Virgden
Hi, Just installed riak and trying to get adjusted. Having looked at the java client, I could not tell if there' a way to check key exixtence. What I need to do is to check if a key exists and put it if it doesn't. In HTTP request from curl, a HEAD request instead of a GET gives the result I need

Deletion followed by re-addition leads to siblings when it shouldn't

2012-07-28 Thread Kaspar Thommen
Hi, I ran the following Java snippet that creates a bucket, stores a key/value pair in it, deletes the key, and adds a new value for that same key. The n-value is 3 and all r- and w-values are also set to 3 to ensure full consistency (for testing only). Here's the code: public static void mai

Re: Java client key existence

2012-07-28 Thread Parnell Springmeyer
The client might not support that, I don't know. I know the Python client (at least the version I'm using) also does a full GET of the object. Here's the kicker though, I'm using LevelDB for the backend and LevelDB is notorious for having poor read performance when you're trying to GET a key tha

Re: Java client key existence

2012-07-28 Thread Mark Phillips
Mark On Jul 28, 2012, at 10:55, Parnell Springmeyer wrote: > The client might not support that, I don't know. I know the Python client (at > least the version I'm using) also does a full GET of the object. > > Here's the kicker though, I'm using LevelDB for the backend and LevelDB is > not

High Memory Utilization

2012-07-28 Thread Antonio Ye
I am using Riak as the persistence data store for a distributed data grid so I really do not care to use Riak's or in my case eLevelDb's cache. The problem I have is that when I load 10 million keys into Riak it is taking 3.6g of memory. I have not set any of the eLevelDb backend configuration para