Re: Attempting to use secondary indexes

2012-01-09 Thread Daniel Rathbone
I'm trying out 2i, and I'm having a little trouble similar to this old thread. I don't see any keys returned when I try and query a secondary index. My storage_backend is set to riak_kv_eleveldb_backend. I seem to have added values to the secondary index well enough - I can see a header "X-Riak-

Re: Attempting to use secondary indexes

2012-01-09 Thread Russell Brown
Hi Daniel, On 9 Jan 2012, at 08:22, Daniel Rathbone wrote: > I'm trying out 2i, and I'm having a little trouble similar to this old > thread. I don't see any keys returned when I try and query a secondary index. > > My storage_backend is set to riak_kv_eleveldb_backend. I seem to have added

Re: riak-erlang-client write, riak-java-client read problem

2012-01-09 Thread Marcel Müller
Hi Sean, thanks for your help but we found another problem: after we insert the valid json: {ok,Pid} = riakc_pb_socket:start_link("10.10.10.74", 8087), Value = mochijson2:encode({struct, [{id, 22}]}), In = riakc_obj:new(<<"mm">>,<<"1">>,Value,"application/json"),

Re: riak-erlang-client write, riak-java-client read problem

2012-01-09 Thread Sean Cribbs
Marcel, Sorry for the confusion, I missed one significant detail. mochijson2:encode/1 will return an iolist (a list of lists and binaries). Wrap the call to mochijson2:encode/1 in erlang:iolist_to_binary/1, like so: Value = erlang:iolist_to_binary(mochijson2:encode({struct, [{id, 22}]})). Hope t

Issue in make all

2012-01-09 Thread suresh chandran
I am trying to install Riak in my macbook. I installed erlang using "sudo port install erlang +ssl" . When i do a "make all" in riak, i get the below error and it quits. I am trying to install the source as mentioned http://wiki.basho.com/Building-a-Development-Environment.html. For some weird

Re: Issue in make all

2012-01-09 Thread Sean Cribbs
Suresh, We do not officially support R15B yet, but you can try changing the regex in rebar.config to include R15. {require_otp_vsn, "R14B0[234]|R15"}. The above should do the trick. On Mon, Jan 9, 2012 at 9:58 AM, suresh chandran wrote: > I am trying to install Riak in my macbook. I installed

Re: Issue in make all

2012-01-09 Thread suresh chandran
Thanks Sean I tried it. But it still reports the same issue. On other hand, is it picking the regex from somewhere else, cos' i dont see the regex to match r13b04 which it says is supported. Thanks Suresh Chandran From: Sean Cribbs To: suresh chandran Cc:

Re: Issue in make all

2012-01-09 Thread suresh chandran
Also, I uninstalled the older Erlang and installed, 14B03 sing the below set of commands. curl -O https://raw.github.com/spawngrid/kerl/master/kerl; chmod a+x kerl ./kerl build R14B03 r14b03 ./kerl install r14b03 /opt/erlang/r14b03 . /opt/erlang/r14b03/activate to resolve this version issue

Re: Issue in make all

2012-01-09 Thread Jared Morrow
Try cleaning out the directory with a 'make clean distclean pkgclean' The regex to set the supported erlang version is in the rebar.config file if you do want to change that. And build again. -Jared On Jan 9, 2012, at 9:51 AM, suresh chandran wrote: > Also, I uninstalled the older Erlang and

Re: Attempting to use secondary indexes

2012-01-09 Thread Daniel Rathbone
That cleared it up, thanks! Indeed, I was trying to add the index k/v as regular meta in the headers. On Mon, Jan 9, 2012 at 12:37 AM, Russell Brown wrote: > Hi Daniel, > > On 9 Jan 2012, at 08:22, Daniel Rathbone wrote: > > I'm trying out 2i, and I'm having a little trouble similar to this old

Re: Issue in make all

2012-01-09 Thread suresh chandran
Thanks Jared. i ran the make clean command as you said, and it  did work. but then it didnt create the dev directory. I am only familiar with the instructions on how to run a three node cluster ( dev1, 2 and 3) riak . I tried doing made devrel and I get this error below. I already set a three

Re: Issue in make all

2012-01-09 Thread suresh chandran
The issue still prevails. After the make clean when i do a make all or make devrel, it still says the version mismatch and quits. Altering the rebar.config doesnt help either. Thanks Suresh Chandran From: suresh chandran To: Jared Morrow Cc: "riak-users@lis

Re: Issue in make all

2012-01-09 Thread Jared Morrow
If you are doing this from the source tarball, try blowing away the untar'd directory and start from scratch. Something must be hanging around your build directories if you no longer have r15B on your system. -Jared On Jan 9, 2012, at 10:28 AM, suresh chandran wrote: > The issue still preva

Re: Issue in make all

2012-01-09 Thread Bip Thelin
This also has to be done for some of the deps so go through your riak/deps/* dirs and correct rebar.config accordingly. We run (although not in production yet) R15B on Mac OSX and Debian 6.0. -- Bip Thelin Evolope AB | Lugnets Allé 1 | 120 33 Stockholm Tel 08-533 335 37 | Mob 0735-18 18 90 www.

Re: Newbie question 2/3

2012-01-09 Thread Ryan Zezeski
John, To your first question, yes, it is possible that the client may receive a failure response from Riak but the data could have persisted on some of the nodes. This is because a single write to Riak is actually N writes to N different partitions inside of Riak. These N writes are not atomic i

Re: missing writes / inconsistent number of keys read after a bulk write

2012-01-09 Thread Karthik K
(Changing subject to reflect the problem better and reposting ). Any idea , based on the configuration inline as to what explains the inconsistency number of keys read after a bulk write ( say 1M of payload 1000 bytes ). Any appropriate write flush setting , that is missed on the client / server

Re: Newbie question 3/3

2012-01-09 Thread Ryan Zezeski
John, As you already seem to understand, Riak doesn't provide a way to make multiple ops atomic. Part of the reason is because Riak's main focus thus far has been availability. Distributed transactions would work, but at the cost of availability. I think a flaw with the redo log approach is tha

SSDs instead of SAS.

2012-01-09 Thread David McNicholl
Hello All. We currently have a large number of DL 380 HPs with 8 SAS disks in a raid 10 for our Riak cluster. One of the ways in which we were considering increasing performance is to move the Riak files off to SSD. Has anyone on the list moved to SSDs? Have you any statistics on perform

Re: SSDs instead of SAS.

2012-01-09 Thread Will Moss
I don't have any exact statistics, but I'm willing to personally guarantee you will not be disappointed. Both Riak back ends are essentially doing random IO, and in practice we've found our disks to be entirely bounded by seek time. Will On Mon, Jan 9, 2012 at 3:05 PM, David McNicholl wrote: >

Re: SSDs instead of SAS.

2012-01-09 Thread Jeremiah Peschka
The archives are searchable through markmail.org If you are doing anything that will read from disk, SSDs will improve your performance. If you are doing any reads from disk that are non-sequential, SSDs will really increase your performance. However, make sure you do the reading on the SSDs you'

Re: SSDs instead of SAS.

2012-01-09 Thread Jason J. W. Williams
> > However, make sure you do the reading on the SSDs you're going to purchase > because not all SSDs are created equal. I had a client buy some smaller > OCZ-Vertex 3s recently which have a wear leveling issue (the 120GB drives > have fewer chips than the 240GB drives) that causes performance to f

Re: SSDs instead of SAS.

2012-01-09 Thread Paul Armstrong
At 2012-01-09T15:12-0800, Jeremiah Peschka wrote: >However, make sure you do the reading on the SSDs you're going to >purchase because not all SSDs are created equal. I had a client buy >some smaller OCZ-Vertex 3s recently which have a wear leveling issue >(the 120GB drives have few

Re: Newbie question 2/3

2012-01-09 Thread John DeTreville
Thanks for the reply, which confirms what I expected. Let me explain why I asked. I have an application that my intuition says would be a good match to Riak, but I don't trust my intuition since I've never used Riak and I'm not sure I understand all of its failure modes. One thing I'm trying is

Re: Newbie question 3/3

2012-01-09 Thread John DeTreville
Right, I certainly don't want distributed transactions, which I agree would destroy availability. (I should add that my system is geographically distributed, making everything much worse.) Still, that leaves open the question of doing what my application needs without transactions. Let's consid

Re: Newbie question 1/3

2012-01-09 Thread Jeffrey Massung
John, welcome to Riak and the forums. Question 1: Availability. Welcome to the list and thank you for the questions. I'm going to answer 1/3 and hopefully help you form your mental model a little bit better. The short answer is that the odds of having the kind of _un_availability you are propo

Re: missing writes / inconsistent number of keys read after a bulk write

2012-01-09 Thread Alexander Sicular
Not sure how your binding does it but MyBucket.keys() should be calling the list keys feature of riak via the streaming mode which chunks the key reply instead of buffering and sending one entire list of keys. @siculars on twitter http://siculars.posterous.com Sent from my iRotaryPhone On Ja

RE: Newbie question 3/3

2012-01-09 Thread Erik Søe Sørensen
One thing to be aware of, in a multi-cluster setup such as you apparently (will) have, is that cluster2cluster synchronization gives no ordering guarantees: Updates at one cluster on two different keys may arrive at the other cluster in any order. From: r