Re: Riak behind a Load Balancer

2012-09-09 Thread Matt Black
I'm currently running six Riak nodes on EC2 small instances behind an ELB. This works fine for us - although when running a large map reduce task we connect directly to a single node rather than routing through the ELB. I don't have any actual performance statistics to hand, but I could get some if

Re: Riak behind a Load Balancer

2012-09-08 Thread gibraltar
I wonder what happens if one would run a Riak cluster on 5/10/15+ EC2 micro (or small) Linux machines behind Elastic Load Balance? Do you think it would perform well enough for a web site with moderate traffic. Idea is having many many "small" machines rather than couple of "big" machines. An

Re: Riak behind a Load Balancer

2012-09-08 Thread Sean Cribbs
On Sat, Sep 8, 2012 at 12:18 PM, Sebastian Cohnen wrote: > Sean, > > how do you explain these rather huge improvements Amazon presents in their > Dynamo paper? > My point was mainly that the performance benefits vs. complexity overhead you would get from client-side routing is sometimes not as g

Re: Riak behind a Load Balancer

2012-09-08 Thread Sebastian Cohnen
why they do not use load balancers. >> >> The rest of the article is good reading, too. >> >> >> From: "Sean Carey" >> To: "Matt Black" >> Cc: "riak-users" >> Sent: Thursday, August

Re: Riak behind a Load Balancer

2012-09-08 Thread Sean Cribbs
ns why they do not use load balancers. > > The rest of the article is good reading, too. > > > From: "Sean Carey" > To: "Matt Black" > Cc: "riak-users" > Sent: Thursday, August 30, 2012 11:09:00 PM > Subject:

Re: Riak behind a Load Balancer

2012-09-08 Thread Sebastian Cohnen
rom: "Sean Carey" > To: "Matt Black" > Cc: "riak-users" > Sent: Thursday, August 30, 2012 11:09:00 PM > Subject: Re: Riak behind a Load Balancer > > Matt, > Haproxy is my load balancer of choice. You can always run multiple copies of > haproxy

Re: Riak behind a Load Balancer

2012-08-31 Thread Armon Dadgar
> Message: 2 > Date: Fri, 31 Aug 2012 10:07:01 +0100 > From: Guido Medina mailto:lic_...@hotmail.com)> > To: riak-users (mailto:riak-users@lists.basho.com)> > Subject: Re: Riak behind a Load Balancer > Message-ID: (mailto:blu0-smtp26a5bb00d2b81d336444e19d...@phx.gbl)>

Re: Riak behind a Load Balancer

2012-08-31 Thread Guido Medina
od reading, too. *From: *"Sean Carey" *To: *"Matt Black" *Cc: *"riak-users" *Sent: *Thursday, August 30, 2012 11:09:00 PM *Subject: *Re: Riak behind a Load Balancer Matt, Haproxy is my load balancer of choice. You can a

Re: Riak behind a Load Balancer

2012-08-31 Thread Dave Brady
rom: "Sean Carey" To: "Matt Black" Cc: "riak-users" Sent: Thursday, August 30, 2012 11:09:00 PM Subject: Re: Riak behind a Load Balancer Matt, Haproxy is my load balancer of choice. You can always run multiple copies of haproxy and use some type of dynamic

Re: Riak behind a Load Balancer

2012-08-30 Thread Sean Carey
Matt, Haproxy is my load balancer of choice. You can always run multiple copies of haproxy and use some type of dynamic dns with it. We do this in many cases. Haproxy scales well. I've seen a single node sustain multiple gigabits per second with almost no sweat. Thanks. Sean On Monda

RE: Riak behind a Load Balancer

2012-06-27 Thread Dave Greenstein
We're running smoothly behind nginx in a round robin config. One thing to remember is eventual consistency... So, if you have two very quick serial operations, one dependent on the results of the other, be sure to make sure both requests are hitting the same node. Also, it was necessary to bypass t

RE: Riak behind a Load Balancer

2012-06-26 Thread adam
r the same. It may be overkill but it was an easy way to control where reads/writes came from. Original Message Subject: Riak behind a Load Balancer From: Matt Black <matt.bl...@jbadigital.com> Date: Sun, June 24, 2012 11:36 pm To: riak-users <riak-users@lists.basho.com>

Re: Riak behind a Load Balancer

2012-06-25 Thread Eric Moritz
This was mentioned in the book, "Scalable Internet Architectures" I haven't used it but it may be worth a look: http://www.backhand.org/wackamole/ On Jun 25, 2012 3:01 PM, "Michael Clemmons" wrote: ___ riak-users mailing list riak-users@lists.basho.com

Re: Riak behind a Load Balancer

2012-06-25 Thread Michael Clemmons
If your running multiple clients use an LB on each and do failover if the local lb is down. On Mon, Jun 25, 2012 at 11:41 AM, Swinney, Austin wrote: > I use the Amazon Elastic Load Balancer (ELB) on my ec2 riak cluster. I > understand the concerns of LB fail, but for me, using Riak is largely

Re: Riak behind a Load Balancer

2012-06-25 Thread Swinney, Austin
I use the Amazon Elastic Load Balancer (ELB) on my ec2 riak cluster. I understand the concerns of LB fail, but for me, using Riak is largely about ease of use. Easy to deploy, grow, shrink, replace, etc. Using an the ELB allows me to do those things without consulting those who manage the ser

Re: Riak behind a Load Balancer

2012-06-25 Thread Anthony Molinaro
This is almost exactly what we do with our riak clusters (as well as actually all our subclusters). It's actually nice for developer because when they need to talk to a network service they just reference 127.0.0.1 and some port, and haproxy gets them to the right place. This also allows an opera

Re: Riak behind a Load Balancer

2012-06-25 Thread Sean Cribbs
Another typical setup is to have each client node have its own haproxy, and when Riak nodes are added or removed (not a common occurrence, mind you), a configuration management tool like Chef/Puppet/cfengine/etc can adjust the config and signal the process to reload it (I think it's `kill -HUP`). T

Re: Riak behind a Load Balancer

2012-06-25 Thread Samuel Elliott
On Mon, Jun 25, 2012 at 7:36 AM, Matt Black wrote: > Dear list, > > Does anyone have an opinion on the concept of putting a Riak cluster behind > a load balancer? It has been done before. there are various results when searching "riak haproxy" in your favourite search engine. > > We wish to be a

Riak behind a Load Balancer

2012-06-24 Thread Matt Black
Dear list, Does anyone have an opinion on the concept of putting a Riak cluster behind a load balancer? We wish to be able to automatically add/remove nodes from the cluster, so adding an extra layer at the front is desirable. We should also benefit for incoming requests behind shared across all