Riak cluster creation when node named riak@127.0.0.1

Hey list, I'm looking for some advice on the best steps to remedy the situation below. I have an already running (in production) node using the Bitcask backend, which I would like to migrate to eLevelDB for 2i support. My plan was to introduce another node to the cluster with the eLevelDB backend

Secondary indexes on Multi Backend

Hey list, Can someone confirm if 2i will work with multi backend please? I get this error when running an index phase in map reduce: "indexes_not_supported,riak_kv_multi_backend". Yet, the following pull request suggests that this would work: https://github.com/basho/riak_kv/pull/258/commits An

Map Reduce with Python

Hello list, In an M/R query, I'd like to be able to merge objects from two different buckets in my output. So my process is a map phase for each bucket, with a link phase in the middle, and a reduce phase to do a bit of merge processing at the end. client = riak.RiakClient(RIAK_HOST, RIAK_PORT) q

Riak behind a Load Balancer

Dear list, Does anyone have an opinion on the concept of putting a Riak cluster behind a load balancer? We wish to be able to automatically add/remove nodes from the cluster, so adding an extra layer at the front is desirable. We should also benefit for incoming requests behind shared across all

Re: Riak behind a Load Balancer

roxy is my load balancer of choice. You can always run multiple copies > of haproxy and use some type of dynamic dns with it. > > We do this in many cases. Haproxy scales well. I've seen a single node > sustain multiple gigabits per second with almost no sweat. > > > Thanks.

Riak upgrade 1.1.1 -> 1.2

Hey list, I'm going to be doing our first full-cluster upgrade in production soon. The docs suggest this is as easy as stopping a node, upgrading, and restarting the node - doing each node one at a time. Before I start, It'd be great if someone could confirm that I have this right.. :) Thanks Mat

Cloning a cluster / copying all cluster data

Hey again list, Can anyone recommend a process for either cloning a cluster, or backing up a whole cluster's data to restore elsewhere? This would be incredibly useful for creating a new environment to test upgrades and run application regression testing. In the dark old days, it would be a simpl

Riak 1.2 Ubuntu Precise .deb

Hey basho, There's no 32-bit deb listed under Downloads on your website.. I found it eventually, but it should be probably listed for all varieties of Ubuntu. Cheers! ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/

Riak Python Bindings 1.5.0

Hey list, I'm upgrading to Riak 1.2 and moving over to the latest Python bindings at the same time. What's the current recommended install process for this? I'd (obviously) like to use pip for simplicity - but it seems that's not currently working (details below). I recall manually installing prot

Re: Cloning a cluster / copying all cluster data

;> LevelDB that made basho recommend that you stop a node before doing backup, >> I dunno if that was fixed. >> >> If its just for debugging/dev purposes you can just stop sending requests >> to riak while doing the backup and you should definitively be fine. >> >&g

noproc error on Map/Reduce

Hello list, I've written a large map/reduce query using the Python bindings - basically it's an expanded version of the users/tags example in this post: http://basho.com/blog/technical/2010/04/14/practical-map-reduce:-forwarding-and-collecting/ When I run the query it fails with this error, with

Re: riak cluster mitosis

This is something I've been wondering about of late. It seems to me it would be useful to at least be able to tell a single node to take a whole copy of all the data and then leave the cluster. You could then start a new cluster from that node. It would (possibly) save time in backup and restores.

Re: riak cluster mitosis

Hi Simon, My intention for this is to create a pre-prod test environment - so having an exact replica of the data isn't an issue. Previously I have used the riak-admin backup/restore, but the file has grown to about 70GB, and so takes around a day to backup, copy and restore into a new cluster. M

Migrating cluster from 1.1.1 to 1.2.1

Hello list, I just started a cluster migration, and encountered a problem with introducing the first replacement node :) I'm not able to either "cluster plan" or "cluster commit" with the new node: root@ip-10-138-x-221:~# riak-admin cluster join riak@10.130.x.125 Attempting to restart script thr

Re: Migrating cluster from 1.1.1 to 1.2.1

On 30 October 2012 13:42, Matt Black wrote: > Hello list, > > I just started a cluster migration, and encountered a problem with > introducing the first replacement node :) > > I'm not able to either "cluster plan" or "cluster commit" with the new &

Re: More Migration Questions

I still haven't really gotten to the bottom of the best way to do this (short of paying for MDC

Re: Riak and host names

Thanks for this Charlie. I'm running a production Riak cluster on AWS which runs constantly, and I've been wondering how I might be able to easliy stop and start AWS nodes for a testing and benchmarking cluster (to save on cost). By using the 'riaknode1.priv' hostname method you describe, would I

Re: Riak and host names

.dnsdynamic.org > > [3] http://www.dnsomatic.com > > [4] http://code.google.com/p/opendyn/ > > [5] http://gnudip2.sourceforge.net/ > > > > On Jan 7, 2013, at 5:00 PM, Matt Black > wrote: > > > >> Thanks for this Charlie. > >> > >> I&

Re: Riak Node Failure

Hi Pavel, Have you run "riak console" on the server to see what the output is? Could you paste that here? I'm no expert, but I may be able to help diagnose a problem with the node starting. On 14 January 2013 15:19, Pavel Kogan wrote: > Hi all, > > I am running couple of months cluster of 5 Ri

Re: Exception: {"phase":0,"error":"[timeout]

Hi David, This is a known error that has been resolved in trunk, but is yet to be released: https://github.com/basho/riak_kv/issues/290 Any word on a release date, Basho guys? On 25 January 2013 12:52, David Montgomery wrote: > Hi, > > Why will riak throw this type of exception when I have a

Re: leveldb and noatime?

This warning is described in the docs at: http://docs.basho.com/riak/latest/tutorials/choosing-a-backend/LevelDB/#Tuning-LevelDB http://docs.basho.com/riak/1.2.0/tutorials/choosing-a-backend/Bitcask/#Tuning-Bitcask In order to fix this you will need to update /etc/fstab and reboot. On 19 March

Re: Getting multiple values: is iterating or MapReduce preferred?

This is very interesting. I've just been testing a multi-phase map reduce job which was intended to replace some code where we look up several objects sequentially after a small map-reduce job. Sounds like the current application code is the right way to do it.. On 26 March 2013 11:14, John Capr

Large map reduce query

Hi list, I have a non-trivial map reduce query which traverses links between objects across several map phases, constructing a composite object enroute. One of our links is one-to-many, so I use a reduce phase to flatten my set of objects at the end. Would a query of this type be better done as a

Re: Large map reduce query

>> MapReduce query done in a controlled manner (for instance, not initiated by >> users of your application)? >> >> The actual use case of MapReduce queries are important in determining >> >> Thanks, >> >> John Caprice >> >> >> On Mon,

Re: Cluster Leave Behaviour Appears Dependent On Node Leaving?

I believe this is to do with the distribution of data across your cluster. Your data will spread evenly across 2n nodes (4, 8, 16) - so with six nodes your data is spread unevenly and you will different plans depending which node is asked to leave. This command will show you the percentage data s

Map phase timeout

Dear list, I'm currently getting a timeout during a single phase of a multi-phase map reduce query. Is there anything I can do to assist this in running? It's purpose is to backup and remove objects from Riak, so it will run periodically during quiet times moving old data out of Riak into file st

Re: Map phase timeout

nstead as it will give you better > control over the execution and avoid timeout problems. > > Best regards, > > Christian > > > > On 8 Apr 2013, at 00:49, Matt Black wrote: > > > Dear list, > > > > I'm currently getting a timeout during a s

Re: Map phase timeout

t; [1] >> http://docs.basho.com/riak/1.2.0/references/appendices/MapReduce-Implementation/#Configuration-Tuning-for-Javascript >> >> >> >> >> Christian Dahlqvist >> Client Services Engineer >> Basho Technologies >> EMEA O

Re: The suitability of MapReduce

I think an short and explicit discussion of using sequential GETs would be good to add to the docs in [1]. It'll be helpful to put the alternate option in the reader's head so they can evaluate as they're going through the article. Cheers Matt On 9 April 2013 02:02, Jeremiah Peschka wrote: > I

Re: Map phase timeout

up the contents of one or more buckets to disk, > and then restoring afterwards). (As opposed to "file based backup" as > described in http://docs.basho.com/riak/latest/cookbooks/Backups/ , which > is the recommended approach for backups for a production cluster, but won't >

Re: Production server specs for Riak node

There's a lot of information in here: http://docs.basho.com/riak/latest/cookbooks/Linux-Performance-Tuning/ And the sister article, specific to AWS: http://docs.basho.com/riak/latest/cookbooks/Performance-Tuning-AWS/ As ever with Riak, the answer to your question depends on what you're doing :)

Call me maybe blog post

Dear list, What is your take on the conclusions drawn in the following blog post? In our setup, we occasionally suffer lost data through simultaneous writes to the same key - which I mitigate to some extent with locks in the application layer. In fact, the resolution in the application is essenti

Installing protobuf 2.5.0 for Riak Python 2.0

Hello list, I've been eagerly awaiting the latest update to the python bindings, so it was with great enthusiasm that I started on it this morning! However, I'm unable to install the latest v2.5 of protobuf. Has anyone else had problems? Presumably it works for others on different setups. (Sean?)

Re: Installing protobuf 2.5.0 for Riak Python 2.0

ments of the riak_pb package. We intend to move to 2.5 for later > releases. > > > On Tue, Jul 30, 2013 at 11:02 PM, Matt Black wrote: > >> Hello list, >> >> I've been eagerly awaiting the latest update to the python bindings, so >> it was with great ent

RiakNode class in Python client 2.0

I've been looking through the changes to the RiakClient class - and have a question about the nodes list and RiakNode/Decaying class. It seems that the Decaying class is used internally to track error_rates (request failure_rate?) of nodes in the available pool. In the application I maintain, we'

GPG error in Apt

Hey Basho peeps, Looks like you might have signed the latest Riak release with new certificate (or something) - Apt is reporting that the key from http://apt.basho.com/gpg/basho.apt.key is incorrect this morning. > apt-get update W: GPG error: http://apt.basho.com precise Release: The following s

Re: RiakNode class in Python client 2.0

t; concurrent workers will get to take advantage of existing connections, and > your socket/file-handle usage will be less. > > > On Tue, Aug 6, 2013 at 1:07 AM, Matt Black wrote: > >> I've been looking through the changes to the RiakClient class - and have >> a quest

Re: GPG error in Apt

Confirmed as working from my end. On 8 August 2013 05:58, Hector Castro wrote: > Hey Matt, > > That issue should be resolved now. Please ping us if you hit any further > issues. > > -- > Hector > > > On Tue, Aug 6, 2013 at 7:42 PM, Matt Black > wrote: > &

Multi-backend, eLevelDB, & Too many open files

Hey list, We're migrating from our currently operational cluster to a new one in a different EC2 region. As part of this migration, we'd like to move from Bitcask to eLevelDB - mostly for the benefits provided by secondary indexes. We also use Multi-backend configuration, in order to split our va

Re: Multi-backend, eLevelDB, & Too many open files

to "stick": > http://docs.basho.com/riak/latest/ops/tuning/open-files-limit/#Linux > > On Sun, Sep 8, 2013 at 9:15 PM, Matt Black > wrote: > > Hey list, > > > > We're migrating from our currently operational cluster to a new one in a > > different EC2

Storing dates in Secondary Indexes

Hey list. A quick question on best practices really: - Should I use a bin index with ISO8601 format? - Or should I use an Unix timestamp as an integer index? - Is there likely to be a performance difference? (There will certainly be storage size difference). - Has anyone had an spe

Filtering not_found in reduce JS causes SyntaxError

Hey list, A script recently introduced to cleanup old data by deleting it has caused one of our old reporting scripts to start failing with “not_found”. I’d encountered this once before - so I thought the simple introduction of a reduce phase using Riak.filterNotFound would fix it. However, now I

Re: Filtering not_found in reduce JS causes SyntaxError

BTW, this cluster is running 1.4.0 still. If 1.4.2 would fix this issue I could update. On 21 October 2013 10:42, Matt Black wrote: > Hey list, > > A script recently introduced to cleanup old data by deleting it has caused > one of our old reporting scripts to start failing wit

Re: Filtering not_found in reduce JS causes SyntaxError

129}]}] On 21 October 2013 11:58, Matt Black wrote: > BTW, this cluster is running 1.4.0 still. If 1.4.2 would fix this issue I > could update. > > > On 21 October 2013 10:42, Matt Black wrote: > >> Hey list, >&

Re: Filtering not_found in reduce JS causes SyntaxError

a separate thread. On 21 October 2013 12:15, Matt Black wrote: > The plot thickens. Having run the same query a couple more times just now > - I see a different error! (No changes we made to the code). > > Exception: Error processing stream message: > exit:{ucs,{bad_utf8_cha

Phase 2 Timeout

Following on from some earlier errors I was getting, I’m now kind of stuck between a rock and a hard place. One of our statistics reports fails with a timeout during a query.filter_not_found() phase: Exception: {"phase":2,"error":"timeout","input":"[<<\"users\">>,<<\"33782eee0470cac583b136fd063d

Re: LevelDB tuning questions.

Interesting thread! I had used the old 1.2 spreadsheet to calculate cache_size and max_files - and having used the 1.4 spreadsheet, it looks like I should change my config :) However, I'm not seeing anything like the below in my log files. Which log file should I be looking in? Cheers Matt On

Links and uniqueness

else confirm this? Basho peeps, are non-unique links the intended behaviour? Thanks Matt Black ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Links and uniqueness

Apologies for the bump! Basho guys, can I get a confirmation on the uniqueness of links between two objects please? (Before I go an modify the code in my app to suit) Thanks Matt On 19 November 2013 14:31, Matt Black wrote: > Hello list, > > Once upon a time, a link from one

Re: Links and uniqueness

ear ago - it was using a hashmap > for links so duplicates were discarded; > https://github.com/basho/riak-java-client/pull/165 > > - Roach > > On Thu, Nov 21, 2013 at 7:00 PM, Matt Black > wrote: > > Apologies for the bump! > > > > Basho guys, can I get a co

Re: using salt stack with riak

Hi Matt, We manage all our Riak infrastructure with a couple of Salt states and a custom module I wrote which you can see here: https://github.com/saltstack/salt-contrib/blob/master/modules/riak.py There's another Riak module in Salt core, but last time I checked it had less functionality. (I ta

Re: using salt stack with riak

- template: jinja - require: - pkg: riak - defaults: internal_ip: {{ salt['cmd.exec_code']('bash', 'hostname -I') }} On 24 January 2014 04:22, Matt Davis wrote: > Nicely done Matt! Sure would love to see your states... I've got

Multi-backend and retiring storage

Hello list, Apologies in advance for the longish preamble - the question (when I get to it) is fairly straight forward. We’ve been happily running Riak for a couple of years now using multi-backend to map various buckets onto different disk locations (for infosec compliance reasons). Our config