[Help]Riak concurrency problem

2012-09-19 Thread Hải Lưu Tuấn
Hi, I am developing an OTP (One time password) API for my company, and using Riak with riak-python-client to store used passwords. Everytime users try to login, a function will delete all used passwords that are older than 5 minutes: def delete_old_otps(username, pid, EPOCHTIME): client, buck

Riak Recap for September 9 - 18

2012-09-19 Thread Mark Phillips
Evening, Morning, Afternoon to All - Here's a Recap from the last week or so: talks, slides, videos, and more. Also, one of your last RICON reminders: there are less than 30 tickets left. You're advised not to wait until the last minute :) Enjoy, Mark ricon2012.com - Riak R

data modeling question

2012-09-19 Thread Charlie Bowman
I'm in the process of designing an in game messaging system that basically replicates the same functionality of email all within the context of the application. I do not have a ton of experience with true key/value db stores so I'm looking to find a good resource for ideas on how to best model thi

Re: Evolving data model

2012-09-19 Thread Allen Johnson
Thanks for all the responses. Originally I was leaning toward the batch transformation approach thinking that this would help keep map-reduce jobs as simple as possible since they wouldn't have to concern themselves with multiple versions of documents. Perhaps I'm just so used to schema migration

Re: Evolving data model

2012-09-19 Thread Todd Cullen
ThoughtLeadr uses Bip's approach. Its essential lazy schema migration. On Wed, Sep 19, 2012 at 3:03 PM, Reid Draper wrote: > I have also used Bip's method and found it successful. You do need to be > careful to make sure > all reads of your data go through this upgrade-path, but that is easy onc

Re: Evolving data model

2012-09-19 Thread Reid Draper
I have also used Bip's method and found it successful. You do need to be careful to make sure all reads of your data go through this upgrade-path, but that is easy once you realize it :). Reid On Sep 19, 2012, at 5:44 PM, Bip Thelin wrote: > We use a technique that works well for our use cas

Re: Evolving data model

2012-09-19 Thread Bip Thelin
We use a technique that works well for our use case: We store everything as JSON and use the erlang-client, for every object we store we add an opaque schema_version tag to the JSON and then in our model encode/decode routine we parse this schema_version and if the version is not the latest acco

Re: Evolving data model

2012-09-19 Thread Alexander Sicular
I'm of the opinion that the answer is somewhere on the spectrum of maintain code that can read all versions and migrating your data to the latest version. Really you could do both. Just keep appropriate vs info in your data. Personally, I lean towards the former. If you modularize your code wel

Re: Evolving data model

2012-09-19 Thread Deepak Balasubramanyam
It really depends on your use case. Guido's tips on not-null and ignore-properties will help. With *JsonIgnoreProperties* you can also specify which ones you would like to ignore. That helps check ignoring properties that you know *should* exist. Converting your documents to a new format is a lot

Riak on SmartOs won't start

2012-09-19 Thread Callixte Cauchois
Hello, I am trying to get riak working on SmartOs using Joyent provided dataset (399e09fc-c448-11e1-b3c8-a3d517dfbb07 smartos 2012-07-02 sdc:sdc:riak:1.6.1). It doesn't start. When using riak console, I get this error message: 18:48:37.011 [error] CRASH REPORT Process riak_core_handoff_listener wi

Re: Evolving data model

2012-09-19 Thread Guido Medina
We have done similar things, but it always depends on the available tools, your requirements and needs, I will give you a short example, our main application uses a standard SQL, for historical data we use Riak, data that is not changing, for example, audit trails, daily chunks from different s

Re: Evolving data model

2012-09-19 Thread Pinney Colton
Wow, that's a pretty big question. IMO, it depends upon what you're doing with your data. Personally, I'm storing up to 4 different "versions" of the same data in Riak, each version is optimized for different types of analytical operations. That's probably not ideal for everybody. Heck, storing

Re: Specified w/dw/pw values invalid for bucket n value of 1

2012-09-19 Thread Ingo Rockel
Hi Russell, I'm using riak 1.2 and the client version is version 1.0.5 and concerning HTTP and PB, I tried both. Ingo Am 19.09.2012 16:04, schrieb Russell Brown: On 19 Sep 2012, at 14:54, Ingo Rockel wrote: Hi Mark, thanks for looking into this. I'm using the riak-java-client for access

Re: Specified w/dw/pw values invalid for bucket n value of 1

2012-09-19 Thread Russell Brown
On 19 Sep 2012, at 14:54, Ingo Rockel wrote: > Hi Mark, > > thanks for looking into this. > > I'm using the riak-java-client for accessing riak, Are you using HTTP or PB, please? And can you let me know the version, too? Thanks Russell > the bucket is created with the following code: > > m

Re: Specified w/dw/pw values invalid for bucket n value of 1

2012-09-19 Thread Ingo Rockel
Hi Mark, thanks for looking into this. I'm using the riak-java-client for accessing riak, the bucket is created with the following code: msgBucket = riakClient.createBucket(MSG_BUCKET_ID). nVal(1).w(1).dw(1).pw(1). execute(); and the write operation is