Re: timeouts while rebalancing

2010-12-21 Thread Colin Surprenant
an > Daniel Reverri > Developer Advocate > Basho Technologies, Inc. > d...@basho.com > > > On Mon, Dec 20, 2010 at 5:18 PM, Colin Surprenant > wrote: >> >> Yup, same version. >> >> On Mon, Dec 20, 2010 at 7:58 PM, Alexander Sicular >> wrote: >&

Re: timeouts while rebalancing

2010-12-20 Thread Colin Surprenant
Yup, same version. On Mon, Dec 20, 2010 at 7:58 PM, Alexander Sicular wrote: > Did you add the same version of riak to your 0.10.1 cluster? I wouldn't > mismatch... > > On Dec 20, 2010, at 3:46 PM, Colin Surprenant wrote: > >> Hi, >> >> Actually, they

Re: timeouts while rebalancing

2010-12-20 Thread Colin Surprenant
insert new keys while the cluster is rebalancing? Again, I cannot find any error report other that riak-admin failing with a timeout as described below. Any help/hints approciated, thanks! Colin On Mon, Dec 20, 2010 at 2:50 PM, Colin Surprenant wrote: > Hi, > > I just added a 4th node

timeouts while rebalancing

2010-12-20 Thread Colin Surprenant
Hi, I just added a 4th node in my 0.10.1 + innostore cluster and I am seeing all kind of timeouts both for retrieving objects and trying to execute riak-admin status which gives me: RPC to 'r...@x.x.x' failed: {'EXIT', {timeout,

Re: deletes vs innostore size

2010-12-09 Thread Colin Surprenant
be > some wasted space and small numbers of deletions won't greatly affect the > used storage. > > Sean Cribbs > Developer Advocate > Basho Technologies, Inc. > http://basho.com/ > > On Dec 7, 2010, at 11:50 AM, Colin Surprenant wrote: > >> Hi, >> >

deletes vs innostore size

2010-12-07 Thread Colin Surprenant
Hi, How does innostore deal with key deletions? will it automatically shrink in size relative to the amount of keys deleted? if not, is there an optimize/compact function somewhere for that? Thanks, Colin ___ riak-users mailing list riak-users@lists.ba

Re: upgrade process?

2010-11-24 Thread Colin Surprenant
>> 1. Take down one node at a time and innodump the data so I have a >> known good backup > > > If you're taking each node down, why not simply backup the filesystem > instead of using innodump? Restoring the filesystem should work just as > well, right? That way you'd have a backend agnostic proce

Re: upgrade process?

2010-11-23 Thread Colin Surprenant
On Tue, Nov 23, 2010 at 10:18 AM, David Smith wrote: > In our internal testing we have started verifying that > sequential releases (i.e. 0.12 -> 0.13) support the rolling upgrades > cleanly. Great stuff. May I suggest to add this fact into the rolling upgrade wiki page? > Given the leap of the

Re: upgrade process?

2010-11-23 Thread Colin Surprenant
On Mon, Nov 22, 2010 at 11:47 AM, Mark Phillips wrote: > > We just added a page to the wiki (this very morning, in fact) with > rolling upgrade instructions for Debian, Redhat and Solaris. > > http://wiki.basho.com/display/RIAK/Rolling+Upgrades Are there any restrictions, incompatibilities betwee

Re: upgrade from 0.10 to 0.13 while full cluster shutdown

2010-11-15 Thread Colin Surprenant
innostore files before you > do anything. :) > > D. > > On Fri, Nov 12, 2010 at 3:01 PM, Colin Surprenant > wrote: >> Hi, >> >> What would be the most (time) efficient way for me to upgrade my 3 >> nodes cluster from 0.10 to current 0.13? >> >> It is

upgrade from 0.10 to 0.13 while full cluster shutdown

2010-11-12 Thread Colin Surprenant
Hi, What would be the most (time) efficient way for me to upgrade my 3 nodes cluster from 0.10 to current 0.13? It is not a problem for me to completely shutdown the cluster for the upgrade operation, unless it takes longer than a few hours. My cluster is configured with innostore and each node

Re: bitcask and innostore overheads

2010-10-04 Thread Colin Surprenant
Hi! I just got this OMG moment after reading Sean's comment on Innostore's buffer pool invalidation when using random patterns for the key space. I am at the point where the relative poor write performance of my Riak setup has started to bite me. I am using Innostore and not using Bitcask because

flow_timeout and js_vm_count

2010-04-28 Thread Colin Surprenant
Hi, For the record, in case someone else run into the same problem: after adding a bit more processing logic into a javascript mapper my mapreduce jobs started generating flow_timeout errors like these: =ERROR REPORT 27-Apr-2010::16:36:30 === ** State machine <0.321.0> terminating ** Last mes

Re: javascript function caching

2010-04-27 Thread Colin Surprenant
gt; 'riak-admin js_reload'. This should cause Riak to reload all predefined JS > functions. > > --Kevin > On Apr 27, 2010, at 11:40 AM, Colin Surprenant wrote: > >> Hi, >> >> It looks like Riak is caching my named javascript functions WITHIN an >>

javascript function caching

2010-04-27 Thread Colin Surprenant
Hi, It looks like Riak is caching my named javascript functions WITHIN an anonymous map function. For example my mapper is something similar to: function(v) { var innerfunction = function(arg) { ... } ... } and modifications to my innerfunction are not picked up when executing my mapr

Re: external http calls from map functions?

2010-04-16 Thread Colin Surprenant
ked/streaming results set to consider. In the same line of thoughts I could just setup a listener on the result stream and feed it back into the intermediate queuing. Thanks, Colin > > --Kevin > On Apr 15, 2010, at 11:20 PM, Colin Surprenant wrote: > >> I'll rephrase my

Re: external http calls from map functions?

2010-04-15 Thread Colin Surprenant
I'll rephrase my question: Is it possible to call external http services from a map function in JavaScript and/or Erlang? Any comments/pointers appreciated. Thanks, Colin On Thu, Apr 15, 2010 at 12:44 PM, Colin Surprenant wrote: > Hi, > > I am trying to figure what the fastest w

external http calls from map functions?

2010-04-15 Thread Colin Surprenant
Hi, I am trying to figure what the fastest way would be to send a mapreduce result set for indexing into a searchengine system like elasticsearch. Of course, the trivial way to do it would be to simply gather the result set and push it back into the indexer using their http/rest api. Now, elasti

Re: model for a time index on realtime data

2010-04-13 Thread Colin Surprenant
Alexander, Great post, lots of information, thanks for sharing this. On key size, I agree it is important to understand that Riak will not retrieve partial keys. I think I read in the list that they may eventually allow partial retrieval of only header information on keys. I think this would be a

Re: link graph traversal

2010-04-12 Thread Colin Surprenant
API-Linkwalking, if > you haven't already. > > Otherwise you need to build your own recursive function. I'm not exactly sure > what that would look like in Riak M/R. > > -Alexander > > > On Apr 12, 2010, at 5:07 PM, Colin Surprenant wrote: > >> Hi,

link graph traversal

2010-04-12 Thread Colin Surprenant
Hi, If I create a linked list of many items (unknown size) in a bucket, for example, item1 links to item2, item2 links to item3, and so on, is there a way to retrieve the complete set of items in a single link-walking query or mapreduce query?? It looks like it only gathers the item direct childs