Re: Looking for a replacement datastore

2012-08-16 Thread Alexander Sicular
Hi Shawn, tl;dr use Riak and Redis. Could you do it without Redis? Probably. Would I want to? No. I'll take a stab at this. It goes without saying that there are many ways to do this and no "right" way. Each solution will have its own positives and negatives. It all depends on what you and you

riak-erlang-client issue with Riak EE 1.2

2012-08-16 Thread Julian
Hi, Recently, we upgraded our Riak cluster to 1.2. I hear that one of our buckets has been wiped and reloaded, but our index (Riak search is enabled) may not be in a consistent state. This has led to an error in code using riak-erlang-client 1.2, shown below. One of the intriguing things I find i

Looking for a replacement datastore

2012-08-16 Thread Shawn Parrish
Howdy Riak folk, We're looking for a possible datastore replacement for our server monitoring check results. Maybe some of you can offer feedback if Riak is a possible good solution. Each ping, http request, etc has a result with various metadata that we store. We're looking at about 250 millio

Re: Riak Recap for August 4 - 15

2012-08-16 Thread Mark Smith
> 8) Basho released some Nagio scripts for Riak. > > * Code here ---> https://github.com/basho/riak_nagios I also suggest the script I've written last year: https://github.com/xb95/nagios-plugins/blob/master/check_riak.py You can use this script to check the number of siblings, object size,

Questions around Riak "these days"

2012-08-16 Thread Mike Oxford
Used to be we had to write "resolvers" due to write-heavy collisions on the same kv, to handle the children. Does Riak have any built-in resolvers (yet?) or is everyone still using statebox or something else? What's the current state of Riak in this regard, and is there anything in progress along

Riak Recap for August 4 - 15

2012-08-16 Thread Mark Phillips
Morning, Afternoon, Evening to All - Here's a Recap to catch you up on the last few weeks. We've got code, blogs, videos, and more. Enjoy. Mark twitter.com/pharkmillups Riak Recap for August 4 - 15 = 1) We added a whole mess of RICON talks to the schedule (and we still have

Re: eLevelDB max_open_files in 1.2.0

2012-08-16 Thread Dave Brady
Thanks, Mark! I have a somewhat-related follow up question: is there a recommended maximum for the amount of data held on a machine? I ask because at my previous company Cassandra was used, and we were advised to put no more 250 GB per physical box. The reasoning was that in a failure situati

RE: How to store a list in riak?

2012-08-16 Thread ZhouJianhua
Hi Kresten, thank you for your reminding. One bucket, "messages", is used to classify the message.A message is rather small and is appended to the list one by one. The messages/_beta is used to store the first key and last key of messages, and its value is something like: {"first": "1", "last"

Re: How to store a list in riak?

2012-08-16 Thread Kresten Krab Thorup
The most interesting piece of information is really how you expect to access the data. That should be the starting point for designing the data layout. Also, ... What are the kinds of lookups typically needed? How many different "messages/" buckets do you expect? Order of magnitude numbers ...

How to store a list in riak?

2012-08-16 Thread ZhouJianhua
Hi, I want to store a list and append item to it later. Is it suitable to do this in riak?My scheme is like this: message: bucket of all messages; message/_meta: an object to store the first index and last index of list; message/n: key of message, such as message/1, message/2, ... I have ne