Intermittent MapReduce crashes (reserve_vm)

2012-04-25 Thread Brian Conway
I have a test cluster of 3 nodes running locally (virtualized), with default configuration + eleveldb. The nodes have plenty of ram and never hit swap. I've already bumped up the JS VM count (8 -> 24) after getting preflist_exhausted errors, and I now get the follow intermittently when posting to /

Re: Upgrade to 1.1.2 problems

2012-04-25 Thread Joseph Blomstedt
Phil, Given the following lines, >         {reason, >          {{badmatch,{'EXIT',noproc}}, >           [{riak_core_vnode_proxy,call,2}, I'm inclined to think this is an issue with the new vnode routing layer introduced in Riak 1.1. On your Riak 1.1.2 node, make sure your app.config does not con

RE: preflist_exhausted error

2012-04-25 Thread Sati, Mohit
Sean, We installed riak 1.1.1 and selected storage_backend setting to riak_kv_eleveldb_backend. The indexes were enabled by default. I did some testing and they are sending me the keys back. I used the link below which has examples. http://basho.com/blog/technical/2011/09/14/Secondary-Indexes-

Riak Adoption - What can we do better?

2012-04-25 Thread Vishal Shah
Improve library development for languages/platforms. Especially Node.js - proto buffers has been in experimental mode for a while. It's a great start though! And I understand that its harder to have dedicated developers for this. Key based order/range queries Atomic counter ops Check-and-set ops

Re: Where to change config settings, not listed in app.config/vm.args

2012-04-25 Thread Brian Sparrow
Hi German, By default many of these options are not set. You must add them to the config. Just be sure that you are adding them in the correct section (riak_core, riak_kv, etc..). For example the buckey_props settings go in riak_core. I've attached an example app.config with the bucket propert

Upgrade to 1.1.2 problems

2012-04-25 Thread Phil Sorber
We have a 4 node riak 1.0.0 cluster running in production that we want to upgrade to 1.1.2. We set up a test environment that closely mimic's the production one. As close as we possibly can with ec2 hosts. First attempt to jump from 1.0.0 -> 1.1.2 failed. We took into account the mapred_system issu

Re: Riak Adoption - What can we do better?

2012-04-25 Thread Mark Phillips
On Mon, Apr 23, 2012 at 10:33 AM, Mark Phillips wrote: > Update: I'm working on rolling this thread into a blog post with a summary > of all these suggestions and what we're doing to address them in the short > and long term. This will be out today with any luck. > > Thanks for this. Never have I

Where to change config settings, not listed in app.config/vm.args

2012-04-25 Thread German Blejman
The wiki page http://wiki.basho.com/Configuration-Files.html mentions several configuration options/sections that are not listed in /etc/app.config or /etc/vm.args after installation. Ie: adjusting n_val value or the whole default_bucket_props section Am i missing something? Using version 1.1.1 T

Re: Backing up riak

2012-04-25 Thread Swinney, Austin
I'd like to preface my comments by saying we love your product! We've really got high hopes for Riak at Vimeo! Also, my interest in backups has mainly to do with data corruption/loss from developers doing something bad. Hence, a node loss is one scenario, but having to restore all data from b

Riak Java Client Cookbook update

2012-04-25 Thread Brian Roach
Greetings Riak Java people! We've recently completed a couple pages for the Riak Java Cookbook that I wanted to share: Fetching Data from Riak: https://github.com/basho/riak-java-client/wiki/Fetching-Data-from-Riak Storing Data in Riak: https://github.com/basho/riak-java-client/wiki/Storing-dat

Re: Backing up riak

2012-04-25 Thread Mark Phillips
Hi Austin, On Tue, Apr 24, 2012 at 9:31 AM, Swinney, Austin wrote: > Hi, > > I'm using leveldb on a 5 node ec2 cluster. I've read about the basic tar > zipping of leveldb and ring files per node. Also, I read about riak-admin > backup all. > > I'm curious about a couple things. > > 1) is the `

Scaliak 0.1.1-SNAPSHOT Available on OSSRH

2012-04-25 Thread Jordan West
Last week StackMob open-sourced the Riak client library we use in our Scala applications, Scaliak (https://github.com/stackmob/scaliak). 0.1.1-SNAPSHOT is now published to Sonatype's OSSRH (oss.sonatype.org). Only a 2.9.1 artifact is available at this time but we will providing ones for newer versi