Re: Rebalancing pain and 100 percentile stat

2012-01-10 Thread Ian Plosker
Elias, Which Riak release are you running? Riak 1.0.2? -- Ian Plosker Developer Advocate Basho Technologies On Tuesday, January 10, 2012 at 2:48 PM, Elias Levy wrote: > On Tue, Jan 10, 2012 at 11:27 AM, David Smith (mailto:diz...@basho.com)> wrote: > > > > Rebalancing can be quite expensi

Re: Rebalancing pain and 100 percentile stat

2012-01-10 Thread Elias Levy
On Tue, Jan 10, 2012 at 11:27 AM, David Smith wrote: > > Rebalancing can be quite expensive with the default claim algorithm > that ships in all releases to date. In the 1.0.3 release (dropping > this week, I hope), we will be switching to a new default claim > algorithm that will dramatically de

Re: Rebalancing pain and 100 percentile stat

2012-01-10 Thread David Smith
On Tue, Jan 10, 2012 at 11:17 AM, Elias Levy wrote: > Is this expected behavior?  Granted, these are EC2 boxes and Leveldb depends > heavily on disk, but I can't imagine folks using Riak on production his this > type of performance hit resulting from rebalancing. tl;dr - yes, adding nodes can cr

Re: Rebalancing pain and 100 percentile stat

2012-01-10 Thread Joseph Blomstedt
I'll leave the stats questions for someone else, but I'll try to answer your rebalancing questions. First off, what ring size is your cluster? If it's larger than 256, you could be hitting a known gossip overload condition. Generally, anything under 1024 is fine, but for EC2, 256/512 may be the re