Re: Understanding Riaks rebalancing and handoff behaviour

2010-11-09 Thread Sven Riedel
On Nov 9, 2010, at 4:30 PM, Alexander Sicular wrote: > Mainly, I'm of the impression that you should join/leave a cluster one > node at a time. > Of course that is what I did when I told all nodes to join/leave. Tell node1 to leave. Wait until riak-admin ringready returns true. Tell node2 to le

Re: Understanding Riaks rebalancing and handoff behaviour

2010-11-09 Thread Justin Sheehy
On Tue, Nov 9, 2010 at 10:30 AM, Alexander Sicular wrote: > Mainly, I'm of the impression that you should join/leave a cluster one > node at a time. This impression is correct. I believe that in the not-too-distant future a feature may be added to enable stable addition of many nodes at once, bu

Re: mapreduce

2010-11-09 Thread Andrea Campolonghi
Thanks Kevin. I am testing in this way and I submit this: { "inputs": "bucket", "query": [ { "map": { "language": "javascript", "source": "function(value, keyData, arg){var data = Riak.mapValuesJson(value)[0];if(data.expires == 0){return [value.key];}}", "kee

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Kevin Smith
Jan - I am hacking on it a bit to more closely match your use case. As soon as I have it done I will send it and the test generation script I'm using to populate test data. --Kevin On Nov 9, 2010, at 10:35 AM, Jan Buchholdt wrote: > Kevin - > > The test client is part of a bigger system and

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Jan Buchholdt
Kevin - The test client is part of a bigger system and would be a bit too much top send to you. The method that is calling Riak looks like this: import com.basho.riak.client.*; . . public List lookupDocuments(String personId, String url) { RiakClient riak = new RiakCli

Re: Understanding Riaks rebalancing and handoff behaviour

2010-11-09 Thread Alexander Sicular
Mainly, I'm of the impression that you should join/leave a cluster one node at a time. -Alexander. On 2010-11-09, Sven Riedel wrote: > Hi, > I'm currently assessing how well riak fits our needs as a large scale data > store. > > In the course of testing riak, I've set up a cluster in Amazons wit

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Karsten Thygesen
Hi Each server have 18GB of memory and 8GB swap, which is not in use at all... So there should be plenty of memory. Riak itself is using around 5-6GB of memory, so plenty to spare... output from top: last pid: 11849; load avg: 0.02, 0.02, 0.02; up 14+01:47:26

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Karsten Thygesen
On Nov 9, 2010, at 14:58 , Kevin Smith wrote: > > On Nov 9, 2010, at 5:01 AM, Karsten Thygesen wrote: > >> Hi >> >> OK, we will use a larger ringsize next time and will consider a data reload. >> >> Regarding the metrics: the servers are dedicated to Riak use and it not used >> for anything

Re: mapreduce

2010-11-09 Thread Kevin Smith
That is the JSON format for a MapReduce job. You need to POST it to the mapred end point like so: curl -XPOST -H"content-type=application/json" -d - http://localhost:8098/mapred --Kevin On Nov 9, 2010, at 5:54 AM, Andrea Campolonghi wrote: > I am testing the riak mapreduce syntax. > > I am usi

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Kevin Smith
On Nov 9, 2010, at 5:01 AM, Karsten Thygesen wrote: > Hi > > OK, we will use a larger ringsize next time and will consider a data reload. > > Regarding the metrics: the servers are dedicated to Riak use and it not used > for anything else. They are new HP servers with 8 cores each and 4x146GB

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Les Mikesell
On 11/9/10 4:10 AM, Karsten Thygesen wrote: The cluster consists of 4 exactly similar nodes - all dedicated to riak use only - no other zones or tasks going on. We use Riak-EE 0.13. The servers is HP servers with 4 x 146GB 10K RPM SAS disks. There is a memorycache on the RAID controller and it i

Understanding Riaks rebalancing and handoff behaviour

2010-11-09 Thread Sven Riedel
Hi, I'm currently assessing how well riak fits our needs as a large scale data store. In the course of testing riak, I've set up a cluster in Amazons with 6 nodes across two EC2 instances (m2.xlarge). After seeing surprisingly a surprisingly bad write performance (which I'll write more on in a

mapreduce

2010-11-09 Thread Andrea Campolonghi
I am testing the riak mapreduce syntax. I am using the default bucket and I am sure I have something inside in json format. curl -v GET http://localhost:8098/riak/bucket/susi get me back : {"idleTime":0,"expires":0,"timeIdle":0,"created":1289247328234,"hits":0,"lastModified":1289247328234,"expr

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Karsten Thygesen
Hi Ryan Thanks for helping out!! The cluster consists of 4 exactly similar nodes - all dedicated to riak use only - no other zones or tasks going on. We use Riak-EE 0.13. The servers is HP servers with 4 x 146GB 10K RPM SAS disks. There is a memorycache on the RAID controller and it is used du

Re: Slow performance using linkwalk, help wanted

2010-11-09 Thread Karsten Thygesen
Hi OK, we will use a larger ringsize next time and will consider a data reload. Regarding the metrics: the servers are dedicated to Riak use and it not used for anything else. They are new HP servers with 8 cores each and 4x146GB 10K RPM SAS disks in a contatenated mirror setup. We use Solaris