Amazon S3 benchmarking with basho_bench

2013-01-03 Thread Koen van Besien
Dear List, Just wondering if there was already an s3 driver for basho_bench? I found the LeoFS bansho_bench driver https://github.com/leo-project/leofs/tree/master/test But if you try this one on a real S3 implementation (so not LeoFS), it does not provide all needed headers For example the da

Re: Atomicity of if_not_modified?

2013-01-03 Thread qaspar
Hi, Can someone confirm this? If it's true, what exactly is the purpose of offering the if_not_modified flag? Kaspar On Dec 28, 2012 1:51 PM, "Daniil Churikov [via Riak Users]" < ml-node+s197444n4026431...@n3.nabble.com> wrote: > Riak doesn't have atomic updates. This if_not_modified does not gi

Re: store performance

2013-01-03 Thread Brian Roach
On Wed, Jan 2, 2013 at 1:04 PM, catchme wrote: > Hello, > I am trying to store 1543400 records using the memory backend. > I have a basic cluster setup with 2 nodes.. > I am using the pbcClient > Bucket b = client.createBucket("test_bucket1").nVal(1).execute(); > //store ob

Re: store performance

2013-01-03 Thread Brian Roach
On Thu, Jan 3, 2013 at 10:01 AM, Brian Roach wrote: > On Wed, Jan 2, 2013 at 1:04 PM, catchme wrote: >> Hello, >> I am trying to store 1543400 records using the memory backend. >> I have a basic cluster setup with 2 nodes.. >> I am using the pbcClient >> Bucket b = client.createBucket("test_bucke

Re: riak-users Digest, Vol 42, Issue 3

2013-01-03 Thread Elias Levy
I believe I've shared this in the past, but to use Basho's Ruby client in non-blocking mode all you have to do is this: https://gist.github.com/4445654 The advantage of doing so it that it gives you the usual blocking API but uses non-blocking IO under the hood. Just create a new Fiber for each n

Re: riak-users Digest, Vol 42, Issue 3

2013-01-03 Thread Elias Levy
On Thu, Jan 3, 2013 at 9:00 AM, wrote: > From: qaspar > > Hi, > > Can someone confirm this? If it's true, what exactly is the purpose of > offering the if_not_modified flag? > > Kaspar > The consistency guarantees of if_not_modified depend on the default R value configured on the bucket propert

Re: Atomicity of if_not_modified?

2013-01-03 Thread Pavan Venkatesh
Hi, If its through http, "ifnotmodified" will only store if there has been no modification since the provided timestamp (conditional store). With your example of N=3, R=2 and W=2, if two clients are updating at the same time to the same object, then it actually depends on the "allow_mult" and "last

Re: Amazon S3 benchmarking with basho_bench

2013-01-03 Thread Marcel Neuhausler
Hi Koen, I did some basho_benching against S3 once. I wrote a simple driver based on erlcloud. Code is in following branch: https://github.com/basho/basho_bench/tree/erlcloud And an example config can be found at: https://github.com/basho/basho_bench/blob/erlcloud/examples/s3.config Hope that he