Re: Schema Architecture, Map Reduce & Key Lists

2011-02-11 Thread Nico Meyer
Hi Jeremiah! Actually there should be no compaction at all if he only ever inserts new keys, so the expire feature of bitcask won't help in this case. Compactions/Merges only happen if keys have been updated or deleted. Cheers, Nico Am Donnerstag, den 10.02.2011, 09:52 -0800 schrieb Jeremiah Pes

Is Riak right for me?

2011-02-11 Thread Mike Stoddart
Riak is very appealing for several reasons; scalability, durability, open-source, performance etc. I'm currently using PostgreSQL for all my storage needs, but I'm investigating nosql (can I use that name?) solutions for scalability and to experiment with map/reduce functionality for statistics and

Re: Is Riak right for me?

2011-02-11 Thread Sean Cribbs
Mike, Sounds like an interesting project. Here are some things to think about (corresponding to your bullet points): 1) What seems fairly natural and obvious for key choice is the timestamp, since so many of your operations are time-oriented. 2) For playback of historical data, consider using M

Re: Is Riak right for me?

2011-02-11 Thread Mike Stoddart
Cool - some very useful information. Much appreciated. I need to digest this a bit before replying with more questions. I'm still trying to understand map/reduce so I'm struggling to get my head around how to apply it to my requirements. I'm obviously used to indexing. :) Thanks Mike On Fri, Feb

has_many :through

2011-02-11 Thread Mat Ellis
We're still thoroughly in an ActiveRecord mindset over here. Before we go and build some simple collect statements to replace a few has_many :through statements, is there some Ripple or Riak goodness we should be using instead? Example: * A Publisher has many Authors who have many Books * We wa

Re: has_many :through

2011-02-11 Thread Sean Cribbs
Mat, In Riak you would implement this pattern with links. Ripple helps you do similar queries to has_many :through, but there is no automatic thing for it yet (it needs some more thought). In the meantime, do this: class Publisher include Ripple::Document many :authors def books au

Re: has_many :through

2011-02-11 Thread Mat Ellis
We're using the links and was going to implement pretty much what you recommend. It wouldn't seem to hard to implement this kind feature via some meta-programming in Ripple, another one for the feature backlog maybe. Thanks M. On Feb 11, 2011, at 12:56 PM, Sean Cribbs wrote: > Mat, > > In Ri

Polymorphism

2011-02-11 Thread Mat Ellis
We build lots of interfaces to other systems. Generally we like to do this using Polymorphism. For instance, if we had to interface with 50 different publishers of books, we'd have one class called "Publisher" with the core logic and then interface specific overrides as "PenguinPublisher", "Ran

Re: Polymorphism

2011-02-11 Thread Sean Cribbs
Ripple supports "single-bucket inheritance". All stored documents contain a "_type" field in the stored JSON object. However, 'find' calls are not scoped to specific types (no indices!), so you must be aware that the type instantiated might not be the same as the requested type. PDI: A check

Riak Recap for Feb. 9 - 10

2011-02-11 Thread Mark Phillips
Afternoon, Evening, Morning to Everyone, We have a massive Recap for today: Riak in GigaOM and ReadWriteWeb, blog posts, IRC convos, a new release for Riak + Spring, KillDashNine-ing in Stockholm and more. ** Before we get to the Recap, a quick announcement: Basho is hiring Developer Advocates! E

Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread Mike Stoddart
I'm trying to compile Riak on Fedora 12 (32 bit) but I'm getting an error: make rel fatal: Not a git repository (or any of the parent directories): .git ./rebar get-deps fatal: Not a git repository (or any of the parent directories): .git fatal: Not a git repository (or any of the parent directori

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread David Smith
On Fri, Feb 11, 2011 at 6:05 PM, Mike Stoddart wrote: > I'm trying to compile Riak on Fedora 12 (32 bit) but I'm getting an error: > ==> rel (generate) > ERROR: Unable to generate spec: Undefined applications: [inets] Try installing the erlang-inets package via yum. It's unfortunate they break u

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread Mike Stoddart
Thanks David, I already had erlang-inets installed. I even tried reinstalling it but it didn't make any difference. Mike On Fri, Feb 11, 2011 at 9:39 PM, David Smith wrote: > On Fri, Feb 11, 2011 at 6:05 PM, Mike Stoddart wrote: >> I'm trying to compile Riak on Fedora 12 (32 bit) but I'm gettin

Re: Riak compile error on Fedora 12 (32 bit)

2011-02-11 Thread David Smith
It might not be perfect, but I spun up a VM + buildslave for fedora and build an RPM this evening: http://dl.dropbox.com/u/2596651/riak-0.14.0.18.gce2ab2c-1.fc13.i686.rpm Maybe that works better? Or is at least functional? :) D. On Fri, Feb 11, 2011 at 7:43 PM, Mike Stoddart wrote: > Thanks Da