Re: riak stats maintenance?

2010-06-18 Thread Germain Maurice

Hi Gareth, and all,

I got the same error, with the latest Riak release 0.11.0, but only one 
time...
Mostly, when i requested "/stats" the host crashed (i have two hosts, 
the both crashed)


The problem ? I think it's a memory issue, because it took memory and 
memory and after, swap space and swap space...

When all is full, the host goes down :(


Le 18/06/10 05:40, Gareth Stokes a écrit :

hey guys,

so i have a cluster of 4 physical machines with a load balancer 
sitting in front to handle requests going into riak.
i thought it would be a good idea (not anymore) to use the /stats url 
to ping the machines the cluster for their health. this is what i've 
noticed in the logs every few days or so


=ERROR REPORT 16-Jun-2010::03:48:37 ===
webmachine error: path="/stats"
{error,{exit,{timeout,{gen_server2,call,[riak_kv_stat,get_stats]}},
 [{gen_server2,call,2},
  {riak_kv_wm_stats,get_stats,0},
  {riak_kv_wm_stats,produce_body,2},
  {webmachine_resource,resource_call,3},
  {webmachine_resource,do,3},
  {webmachine_decision_core,resource_call,1},
  {webmachine_decision_core,decision,1},
  {webmachine_decision_core,handle_request,2}]}}

it lasts anywhere between 5 - 40 minutes.
what im thinking is that a riak machine will enter "maintenance" mode 
every now and then, when it does it turns the /stats url off.


am i correct in thinking this, or should i be worried?

regards,
gareth stokes


___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
   



--
Germain Maurice
Administrateur Système/Réseau
Tel : +33.(0)1.42.43.54.33

http://www.linkfluence.net

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Riak Recap for 6/16 - 6/17

2010-06-18 Thread Mark Phillips
Morning, Afternoon, Evening to all,

For today's recap: a multitude of Gists from #riak to take you into
the weekend along with an orphaned question and an updated Ruby PB
Client.

Good weekend to all -

Mark

Community Manager
Basho Technologies
wiki.basho.com
twitter.com/pharkmillups



RIak Recap 6/16 - 6/17

1) seancribbs and danoyoung had a brief exchange in #riak about
whether there was an equivalent of "drop table" in Riak.

Gist here ---> http://gist.github.com/443707

2) Q --- How about using riak as a distributed filesystem? i need data
streaming and bandwidth throttling, so i'll have to implement it.
(from streaming via #riak)

A --- Several Riak-backed filesystems have appeared, the most
mature of which is probably @crucially's Riakfuse --->
http://github.com/crucially/riakfuse

Without knowing anything exact about the usecase, this might be the
best place to start.

3) theriffer and drev1 had a quick conversation about the advantages
using the PB Client and how links are used in Riak.

Gist here ---> http://gist.github.com/443766

4) duffomelia and seabcribbs talked a bit about the approach for
building a test database for Riak.

Details here ---> http://gist.github.com/443780

5) seancribbs and allen had a lengthy and worthwhile conversation
about benchmarking and basho_bench

Gist ---> http://gist.github.com/443796

6) @acts_as has been hustling on his Riak PB Client and pushed out
version 0.1.5 yesterday

Check out the latest changes here ---> http://github.com/aitrus/riak-pbclient

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


basho_bench results

2010-06-18 Thread Germain Maurice

Hi all,

We led some tests with basho_bench and we got some results here :
http://erralt.wordpress.com/2010/06/18/benching-riak-with-basho_bench/

I put inside the pictures the content of each configuration file we used 
to launch the benchmarks (easier to compare).
When looking at the last benchmark and after 3000 seconds elapsed, can 
we considered that more than 2500 operations are done in one second ? On 
each second can we expect to get the same quantity of read and write 
requests throughout the benchmark ?


Regards,
Germain

--
Germain Maurice
Administrateur Système/Réseau
Tel : +33.(0)1.42.43.54.33

http://www.linkfluence.net

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


Test your MapReduce Functions

2010-06-18 Thread Sean Cribbs
Hey Riak users,

I often get asked how you can test the functions you feed into your MapReduce 
jobs.  Up until last week, I hadn't truly felt the pain of being unable to test 
my map and reduce functions, when I tried to add click-tracking and statistics 
aggregation to my riak-url-shortener.

Thanks to help from Larry Karnowski (@karnowski), I dove into building a test 
harness today. I initially tried Jasmine, which has a very nice in-browser 
mode, but it assumed too much about having the BOM available.  I ended up 
trying out a port of QuickCheck to Javascript 
(http://bitbucket.org/darrint/qc.js/) and so far I like the results.  The 
declarative, functional orientation of QC is a good fit for testing your map 
and reduce functions, especially since they run in relative isolation.

Without further ado, here's my first pass at the harness:

http://github.com/seancribbs/riak-qc.js
http://bitbucket.org/seancribbs/riak-qc.js (may go away)

You'll need a standalone version of Spidermonkey (1.8rc1 or later) to run your 
tests. Once you have SM installed and the project cloned, try "js 
builtins_qc.js" from the terminal.

Caveat emptor -- this is only one day's work! Nevertheless, try it out and give 
me feedback or send pull-requests.  

Sean Cribbs 
Developer Advocate
Basho Technologies, Inc.
http://basho.com/


___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com