Indexing of intermediate nested fields in Riak search

2011-10-29 Thread Elias Levy
I am wondering if Riak search can index intermediate nested fields. When indexing json data through the KV precommit hook, the underscore is understood in the schema as indicating nesting. Thus, foo_bar will index the value "bah" of field "bar" in the json document { "foo" : { "bar" : "bah" } }.

Re: Riak 1.x with Secondary Indexes

2011-10-29 Thread Sean Cribbs
TBH, our clients that support pbufs already do this for you... On Fri, Oct 28, 2011 at 8:26 PM, Mike Oxford wrote: > On Fri, Oct 28, 2011 at 5:36 PM, Sean Cribbs wrote: > > You can already store indexes with pbufs. Use a mapreduce with a single > reduce phase of riak_kv_mapreduce:reduce_identit

Re: atomically updating multiple keys

2011-10-29 Thread Justin Karneges
Thanks, those were very good reads. Eventual consistency I'm okay with. I understand that with a distributed system, clients are generally going to have to cope with not always having the latest data. I'm just trying to avoid littering the database with orphan keys in the event I fail to make

Re: Python Client Protocol Buffers Error

2011-10-29 Thread Reid Draper
Do you have some code that you can send to reproduce the issue? Would you mind sending your app.config as well? On Sat, Oct 29, 2011 at 3:58 PM, Jim Adler wrote: > Ried, > > Riak 1.0.1 from package, Ubuntu 11.04 > > Jim > > From: Reid Draper > Date: Sat, 29 Oct 2011 13:47:02 -0400 > To: Jim Adl

Re: Python Client Protocol Buffers Error

2011-10-29 Thread Jim Adler
Ried, Riak 1.0.1 from package, Ubuntu 11.04 Jim From: Reid Draper Date: Sat, 29 Oct 2011 13:47:02 -0400 To: Jim Adler Cc: "riak-users@lists.basho.com" Subject: Re: Python Client Protocol Buffers Error Jim, What version of Riak are you using? Are you using a package or did you build fr

Re: atomically updating multiple keys

2011-10-29 Thread Reid Draper
Justin, It sounds like your specific needs _might_ be possible with application logic, but be aware that Riak is an eventually consistent database. There are many subtleties to this type of coordination. You will need read-your-writes consistency, which means R + W > N. I would recommend the follo

Re: Python Client Protocol Buffers Error

2011-10-29 Thread Reid Draper
Jim, What version of Riak are you using? Are you using a package or did you build from source? If you built from source, what version of Erlang are you using? Reid On Sat, Oct 29, 2011 at 1:38 PM, Jim Adler wrote: > I'm consistently seeing a key filter query fail with protocol buffers that > w

Re: atomically updating multiple keys

2011-10-29 Thread Jeremiah Peschka
I'm just assuming that my implementation might be naive. As far as the tedious label goes, as your application's functionality grows in complexity, you may find it tedious to manage the complexity of manually handling transactional rollback in a distributed system. Managing relationships using

Python Client Protocol Buffers Error

2011-10-29 Thread Jim Adler
I'm consistently seeing a key filter query fail with protocol buffers that works fine with http. I've seen similar problems reported (http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-April/004 002.html, http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-October/00 60

Re: atomically updating multiple keys

2011-10-29 Thread Justin Karneges
On Saturday, October 29, 2011 08:42:52 AM Jeremiah Peschka wrote: > 1) Use an RDBMS. Since you're here, I'm guessing that you're already using > Riak or else that Riak has qualities that you want for your application. Right. This is early on in the app's lifetime and the data storage is not terr

Re: Riak 1.x with Secondary Indexes

2011-10-29 Thread Jeremiah Peschka
The protocol buffers API already makes it easy to store the indexes. Querying them is annoying, but there's an Erlang client method to query an index that's pretty easy to use. Have a look at the get_index functions in riakc_pb_socket.erl. They're around line 700 or so. --- Jeremiah Peschka - Fo

Re: atomically updating multiple keys

2011-10-29 Thread Jeremiah Peschka
Since it's very difficult, if not impossible, to guarantee the atomicity of any action in a distributed system like Riak, you are very limited in your options. 1) Use an RDBMS. Since you're here, I'm guessing that you're already using Riak or else that Riak has qualities that you want for your a

Re: eleveldb make test failure

2011-10-29 Thread Phil Sorber
This explains a lot. Thanks Jared. On Fri, Oct 28, 2011 at 10:47 PM, Jared Morrow wrote: > Phil, > > I tried reproducing the issue on OSX, Ubuntu 11, and Fedora 13 with no > luck. The curiosity I have is the following > >>undefined symbol: _ZN6snappy13RawUncompressEPKcmPc'"}} >> *** test m