About how via keys get value in riak

2012-06-26 Thread 郎咸武
Hi guys, This is mnesia operation in the following: mnesia:dirty_match_object({comments,{Node, ItemId, '_'}, '_'}). Now, I want to get it from riak. For example:The KEY is {node, itemid, comment1} and {node,itemid, comment2}. I want to get comment1 and c

RE: Riak behind a Load Balancer

2012-06-26 Thread adam
Sorry for top posting you, but I run a riak cluster behind two separate virtual IPs on my load balancer (an F5 LTM), one on a private IP that I write to and one on a public IP that can be read from. I control that behavior with iRules, though I'm sure other LBs have their own mechanism for the same

Innostore users?

2012-06-26 Thread David Smith
Hi all, As the mid-July release of Riak looms large, the Basho team has been discussing our continued support of the Innostore backend. Embedded InnoDB was long ago abandoned by Oracle. We have not been actively working on it either. We believe that alternative designs (like LevelDB) are the futu

Cluster migration due to incorrect "ring_creation_size" value

2012-06-26 Thread Matthew Tovbin
Hi Basho, We have a running cluster of 5 nodes which accidentally was configured with a default setting "{ ring_creation_size: 64 }". As suggested in documentation we cannot scale this cluster more than 6 machines, so the only option is to migrate to a new cluster with a larger ring_creation_size

Re: Indexes in in-memory backend?

2012-06-26 Thread Kaspar Thommen
Great, thanks! Kaspar 2012/6/26 Jeremy Thurgood > On 26 June 2012 20:57, Kaspar Thommen wrote: > > For testing purposes it would be awesome if Riak supported indexes in the > > in-memory backend, are there any plans to implement this at some point? > > It's already implemented. It probably jus

Indexes in in-memory backend?

2012-06-26 Thread Kaspar Thommen
Hi, For testing purposes it would be awesome if Riak supported indexes in the in-memory backend, are there any plans to implement this at some point? Thanks, Kaspar ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/li

Java client: byte arrays as keys?

2012-06-26 Thread Kaspar Thommen
Hi, The high-level API in the Java client library (IRiakClient) does not allow one to use byte[] arrays as keys, only Strings, whereas the underlying PBC and http APIs (e.g. com.basho.riak.pbc.RiakClient) do, via the fetch(ByteString, ...) methods. Any reason for this? Is it planned to add byte ar

Re: Which Java library?

2012-06-26 Thread Jared Morrow
Kaspar, > https://github.com/basho/riak-java-client ^^ The Basho one is the correct one. Russel Brown (the repo owner below) works for Basho and most likely just had a private fork for his work. > https://github.com/russelldb/riak-java-client (last commit August 2011, so > probably outdated?

Which Java library?

2012-06-26 Thread Kaspar Thommen
Hi, I have found two Java libraries so far, and I'm not sure what their connection is or which one I'm supposed to use: https://github.com/basho/riak-java-client https://github.com/russelldb/riak-java-client (last commit August 2011, so probably outdated?) Any hints? Kaspar

Re: 50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Yousuf Fauzan
My client is multi threaded. Instead of haproxy I had ELB in from of my cluster On Tuesday, June 26, 2012, Yousuf Fauzan wrote: > I used ephemeral storage without any improvement. > > Also iotop and iostat did not show any saturation. > > After talking with Sean Cribbs on IRC, I tried disabling n

Re: 50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Yousuf Fauzan
I used ephemeral storage without any improvement. Also iotop and iostat did not show any saturation. After talking with Sean Cribbs on IRC, I tried disabling nagle in riak config, changed IO scheduler to noop, decreased cache size to 1 MB from 372 MB, removed load balancer. After doing all this

Re: Scale up or out?

2012-06-26 Thread Aphyr
On 06/26/2012 07:24 AM, Eric Anderson wrote: Hey all, Question about EC2 (or scale in general): i'm building a decent cluster, to handle 15-20k inserts/s and 5-10k gets per second. (for a rough idea of what I'm doing). I've been playing with a 15-node cluster of m2.xlarge systems, but I am wonde

Re: 50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Jeremiah Peschka
Not being familiar with basho bench, these might seem like stupid questions, but here goes: What are the sizes of the operations that you're performing? How have you configured your EBS storage? A single EBS volume can only perform about 100 I/O operations per second, give or take. A single host

Re: 50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Reid Draper
On Jun 26, 2012, at 11:48 AM, David Smith wrote: > What does your basho_bench config file look like? > > Seeing a low number of ops/sec is usually an indicator that you're > hitting a bottleneck on the I/O path -- typically due to random reads. > LevelDB has a number of characteristics that can

Re: 50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread David Smith
What does your basho_bench config file look like? Seeing a low number of ops/sec is usually an indicator that you're hitting a bottleneck on the I/O path -- typically due to random reads. LevelDB has a number of characteristics that can make this worse -- what happens if you use bitcask? D. On T

50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Yousuf Fauzan
Hello, Here is my setup of Riak 1.1.4 - 5 Nodes - ami-a29943cb (EC2 AMI) - m1.large (7.5GB Ram, 4 EC2 compute instances) - EBS storage - LevelDB backend - Python Client with Protobuf (on a separate machine) While loading data I am getting around 50 ops/sec. I tried running bas

Re: Scale up or out?

2012-06-26 Thread Jeremiah Peschka
Scale out - zerg rush your data. Many smaller systems means that, in theory, you're going to be affected less by poor performance of any single instance. When you're building out instances in EC2 always remember that the largest instance in a class of instances is most likely to be the only VM on

Scale up or out?

2012-06-26 Thread Eric Anderson
Hey all, Question about EC2 (or scale in general): i'm building a decent cluster, to handle 15-20k inserts/s and 5-10k gets per second. (for a rough idea of what I'm doing). I've been playing with a 15-node cluster of m2.xlarge systems, but I am wondering what is better: more small systems or

Re: link walking- get a single object from 1000 objects with tag 'city'

2012-06-26 Thread Bryan Fink
On Mon, Jun 25, 2012 at 6:06 AM, Venki Yedidha wrote: >   I have a document in which my Riak object is linked with > tag name 'city' to nearly 1000 other objects. >   However, If I use /bucketname/keyname/_,city,1 >                        It lists me all cities link

Re: link with out changing data

2012-06-26 Thread Bryan Fink
On Tue, Jun 26, 2012 at 2:43 AM, Venki Yedidha wrote: >     I want to insert Country data first, whenever a city > enters we should link this country to city with out changing the country > data. Hi, Venkatesh. As you have noticed, Riak does not support partial-update operations.

50-100 ops/sec on a 5 Node cluster

2012-06-26 Thread Yousuf Fauzan
Hello, Here is my setup of Riak 1.1.4 - 5 Nodes - ami-a29943cb (EC2 AMI) - m1.large (7.5GB Ram, 4 EC2 compute instances) - EBS storage - LevelDB backend - Python Client with Protobuf (on a separate machine) While loading data I am getting around 50 ops/sec. I tried running bas