Re: Observation on shuffling vs adding/removing nodes

2013-03-24 Thread Andrew Bialecki
Wouldn't shock me if shuffle wasn't all that performant (and not knock on shuffle...our case is somewhat specific). We added 3 nodes with num_tokens=256 and worked great, the load was evenly spread. On Sun, Mar 24, 2013 at 1:14 PM, aaron morton wrote: > We initially tried to run a shuffle, howev

Re: Observation on shuffling vs adding/removing nodes

2013-03-24 Thread aaron morton
> We initially tried to run a shuffle, however it seemed to be going really > slowly (very little progress by watching "cassandra-shuffle ls | wc -l" after > 5-6 hours and no errors in logs), My guess is that shuffle not designed to be as efficient as possible as it is only used once. Was it con

Observation on shuffling vs adding/removing nodes

2013-03-23 Thread Andrew Bialecki
Just curious if anyone has any thoughts on something we've observed in a small test cluster. We had around 100 GB of data on a 3 node cluster (RF=2) and wanted to start using vnodes. We upgraded the cluster to 1.2.2 and then followed the instructions for using vnodes. We initially tried to run a s