Re: Riak upgrade 1.1.1 -> 1.2

2012-09-11 Thread Evan Vigil-McClanahan
And there is always this: http://wiki.basho.com/Rolling-Upgrades.html On Tue, Sep 11, 2012 at 5:55 PM, Sean Cribbs wrote: > Hi Matt, > > We verify rolling upgrades from two releases back. You are safe to proceed in > the rolling upgrade from 1.1 to 1.2. > > Sean Cribbs > > On Sep 11, 2012, at 7

Re: Riak upgrade 1.1.1 -> 1.2

2012-09-11 Thread Sean Cribbs
Hi Matt, We verify rolling upgrades from two releases back. You are safe to proceed in the rolling upgrade from 1.1 to 1.2. Sean Cribbs On Sep 11, 2012, at 7:56 PM, Matt Black wrote: > Hey list, > > I'm going to be doing our first full-cluster upgrade in production soon. The > docs suggest

Re: Cloning a cluster / copying all cluster data

2012-09-11 Thread Matthew Tovbin
Matt, We copied all the data key by key, since we used incorrect 'ring_creation_size' value. ( http://riak-users.197444.n3.nabble.com/Cluster-migration-due-to-incorrect-quot-ring-creation-size-quot-value-td4024509.html ) So, you can use this copy tool - https://github.com/tovbinm/riak-tools, whic

Re: Cloning a cluster / copying all cluster data

2012-09-11 Thread Kresten Krab Thorup
Simply copying the riak/data and riak/etc directories should do the trick. You can use tar, rsync or simply cp as you feel like, and you can do all that while Riak is running at full throttle. The beauty of log structured storage (Bitcask, LevelDB, HainoiDB) At least that's the idea. I seem to

Cloning a cluster / copying all cluster data

2012-09-11 Thread Matt Black
Hey again list, Can anyone recommend a process for either cloning a cluster, or backing up a whole cluster's data to restore elsewhere? This would be incredibly useful for creating a new environment to test upgrades and run application regression testing. In the dark old days, it would be a simpl

Riak upgrade 1.1.1 -> 1.2

2012-09-11 Thread Matt Black
Hey list, I'm going to be doing our first full-cluster upgrade in production soon. The docs suggest this is as easy as stopping a node, upgrading, and restarting the node - doing each node one at a time. Before I start, It'd be great if someone could confirm that I have this right.. :) Thanks Mat

Re: Cluster `plan` "WARNING: Not all replicas will be on distinct nodes"

2012-09-11 Thread Alexander Sicular
If you have too few physical nodes in your cluster it is not guaranteed that every replica will be on its own physical node. You'll still have N replicas but some of them may be physically located on the same physical node. tl;dr add more machines to your cluster. On Tue, Sep 11, 2012 at 6:06 PM,

Cluster `plan` "WARNING: Not all replicas will be on distinct nodes"

2012-09-11 Thread Drew Broadley
Hi there, Could someone please iterate in more detail what the following warning means: WARNING: Not all replicas will be on distinct nodes My assumption is that there is not a clear replication of data across nodes, if one goes down, data could be lost. Cheers, Drew Broadley *PAPERKUT Paperle

Re: Reip in Riak 1.2 vs 1.1.4

2012-09-11 Thread Mark Phillips
Hello again :) On Mon, Aug 27, 2012 at 4:45 AM, Yousuf Fauzan wrote: > Hello, > > My riak setup is on EC2 with EBS volumes storing data and ring state. This > ensures that I can teardown the cluster and restart it with all the data > intact. When I restart the cluster, I do a reip of all nodes on

Re: Cluster start problem

2012-09-11 Thread Wolf Iem
Any idea about random crashes? On 11 Eyl 2012, at 15:19, Sean Cribbs wrote: > Hi Wolf, > > eaddrnotavail in that error means that it can't bind to the network > interface you specified. Verify that your HTTP and PB interfaces are > bound to real IPs assigned to the machine and that the ports ar

Re: Postcommit hook and creating a new object

2012-09-11 Thread Mark Phillips
Hey Yousuf, I'm not sure there's a way to make this cheaper for you. You're going to have to do a GET and work with the not-founds. The alternative would be a HEAD request for the key, which would just return the metadata. This won't save you any time on the request but might cut down on client-se

Re: MapReduce - sorting via the Java client

2012-09-11 Thread Mark Phillips
On Tue, Sep 11, 2012 at 10:47 AM, Deepak Balasubramanyam wrote: > Hi Mark, > > Sure, I can help whip up a page when I find the time. Do I get access to > edit the wiki or should I email ro...@basho.com ? > Hmm. Sadly it looks like there's no pull request support for wiki editing on GitHub. (Full

Re: MapReduce - sorting via the Java client

2012-09-11 Thread Deepak Balasubramanyam
Hi Mark, Sure, I can help whip up a page when I find the time. Do I get access to edit the wiki or should I email ro...@basho.com ? Thanks Deepak Bala On Tue, Sep 11, 2012 at 10:58 PM, Mark Phillips wrote: > Hi Deepak, > > In-line > > On Tue, Sep 11, 2012 at 10:16 AM, Deepak Balasubramanyam >

Re: MapReduce - sorting via the Java client

2012-09-11 Thread Mark Phillips
Hi Deepak, In-line On Tue, Sep 11, 2012 at 10:16 AM, Deepak Balasubramanyam wrote: > I was researching the same question and found the answer after some > tinkering around. You need a JS source function. You must write the JS > source code for the sort algorithm too. > > JSSourceFunction phaseFu

Re: MapReduce - sorting via the Java client

2012-09-11 Thread Deepak Balasubramanyam
I was researching the same question and found the answer after some tinkering around. You need a JS source function. You must write the JS source code for the sort algorithm too. JSSourceFunction phaseFunction = new JSSourceFunction( "function(v) {" + "return v.sort(functio

Re: M/R query with riak-defined keys

2012-09-11 Thread Antoine
On 09/11/2012 07:47 AM, Mark Phillips wrote: > Hey Antoine, > > Sorry for the delay here. Just for the sake of completeness, can you > provide the MapReduce job that's not running? > > Mark Hey, Thanks for your answer ;) It turns out I've managed to make it work, probably was an error in the J

Re: Cluster start problem

2012-09-11 Thread Wolf Iem
Hi Sean, Ignore my last reply. It ok now. It was IP address as you said. Thank you. On 11 Eyl 2012, at 18:11, Wolf Iem wrote: > Hi Sean, > > Thank you for your reply. > We are using default ports, 8098 - 8069 and IP addresses are correct. But > still it doesn't start. > > > On 11 Eyl 20

Re: Cluster start problem

2012-09-11 Thread Wolf Iem
Hi Sean, Thank you for your reply. We are using default ports, 8098 - 8069 and IP addresses are correct. But still it doesn't start. On 11 Eyl 2012, at 15:19, Sean Cribbs wrote: > Hi Wolf, > > eaddrnotavail in that error means that it can't bind to the network > interface you specified. Ver

Re: Cluster start problem

2012-09-11 Thread Sean Cribbs
Hi Wolf, eaddrnotavail in that error means that it can't bind to the network interface you specified. Verify that your HTTP and PB interfaces are bound to real IPs assigned to the machine and that the ports are not in the privileged range (1-1024). On Tue, Sep 11, 2012 at 4:08 AM, Wolf Iem wrote

Re: REST API: Deleting key vs. marking as deleted.

2012-09-11 Thread Kresten Krab Thorup
Hi Vladimir, Yes, deleting an object is actually more expensive than just marking it deleted. What happens is that Riak will delete it in two steps, first it writes a tombstone record for the key, and then some time later it does the real delete. When you do a delete, riak will return success

Re: REST API: Deleting key vs. marking as deleted.

2012-09-11 Thread Guido Medina
Hi, Just an idea, you could have a batch number incrementing once a minute (Integers won't run out of range for at least 20 years) and have your marking be an index name "delete_batch_number", and have a scheduled job to delete once a minute or something where it will just delete the keys w

REST API: Deleting key vs. marking as deleted.

2012-09-11 Thread Vladimir Shapovalov
HI all, Is deleting a key more expensive operation then just marking it as deleted? I noticed that delete a bunch of keys is quite expensive. All CPUs are fully utilized. I can imagine that I can mark the key first and delete them some time later, e.q. not in rush hours. What is actually the bes

Cluster start problem

2012-09-11 Thread Wolf Iem
Hi all, We have 4 nodes Riak installation. They are running on Ubuntu 12.04 LTS Precise installed servers. We have installed 1.1.4 at August 1st 2012 and upgraded 1.2.0 when its available. Server names are: f1 - 10.10.0.12 - This is the first installed server. We have joined other ones to t