Re: riak stats maintenance?
Hi Gareth, and all, I got the same error, with the latest Riak release 0.11.0, but only one time... Mostly, when i requested "/stats" the host crashed (i have two hosts, the both crashed) The problem ? I think it's a memory issue, because it took memory and memory and after, swap space and swap space... When all is full, the host goes down :( Le 18/06/10 05:40, Gareth Stokes a écrit : hey guys, so i have a cluster of 4 physical machines with a load balancer sitting in front to handle requests going into riak. i thought it would be a good idea (not anymore) to use the /stats url to ping the machines the cluster for their health. this is what i've noticed in the logs every few days or so =ERROR REPORT 16-Jun-2010::03:48:37 === webmachine error: path="/stats" {error,{exit,{timeout,{gen_server2,call,[riak_kv_stat,get_stats]}}, [{gen_server2,call,2}, {riak_kv_wm_stats,get_stats,0}, {riak_kv_wm_stats,produce_body,2}, {webmachine_resource,resource_call,3}, {webmachine_resource,do,3}, {webmachine_decision_core,resource_call,1}, {webmachine_decision_core,decision,1}, {webmachine_decision_core,handle_request,2}]}} it lasts anywhere between 5 - 40 minutes. what im thinking is that a riak machine will enter "maintenance" mode every now and then, when it does it turns the /stats url off. am i correct in thinking this, or should i be worried? regards, gareth stokes ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com -- Germain Maurice Administrateur Système/Réseau Tel : +33.(0)1.42.43.54.33 http://www.linkfluence.net ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak Recap for 6/16 - 6/17
Morning, Afternoon, Evening to all, For today's recap: a multitude of Gists from #riak to take you into the weekend along with an orphaned question and an updated Ruby PB Client. Good weekend to all - Mark Community Manager Basho Technologies wiki.basho.com twitter.com/pharkmillups RIak Recap 6/16 - 6/17 1) seancribbs and danoyoung had a brief exchange in #riak about whether there was an equivalent of "drop table" in Riak. Gist here ---> http://gist.github.com/443707 2) Q --- How about using riak as a distributed filesystem? i need data streaming and bandwidth throttling, so i'll have to implement it. (from streaming via #riak) A --- Several Riak-backed filesystems have appeared, the most mature of which is probably @crucially's Riakfuse ---> http://github.com/crucially/riakfuse Without knowing anything exact about the usecase, this might be the best place to start. 3) theriffer and drev1 had a quick conversation about the advantages using the PB Client and how links are used in Riak. Gist here ---> http://gist.github.com/443766 4) duffomelia and seabcribbs talked a bit about the approach for building a test database for Riak. Details here ---> http://gist.github.com/443780 5) seancribbs and allen had a lengthy and worthwhile conversation about benchmarking and basho_bench Gist ---> http://gist.github.com/443796 6) @acts_as has been hustling on his Riak PB Client and pushed out version 0.1.5 yesterday Check out the latest changes here ---> http://github.com/aitrus/riak-pbclient ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
basho_bench results
Hi all, We led some tests with basho_bench and we got some results here : http://erralt.wordpress.com/2010/06/18/benching-riak-with-basho_bench/ I put inside the pictures the content of each configuration file we used to launch the benchmarks (easier to compare). When looking at the last benchmark and after 3000 seconds elapsed, can we considered that more than 2500 operations are done in one second ? On each second can we expect to get the same quantity of read and write requests throughout the benchmark ? Regards, Germain -- Germain Maurice Administrateur Système/Réseau Tel : +33.(0)1.42.43.54.33 http://www.linkfluence.net ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Test your MapReduce Functions
Hey Riak users, I often get asked how you can test the functions you feed into your MapReduce jobs. Up until last week, I hadn't truly felt the pain of being unable to test my map and reduce functions, when I tried to add click-tracking and statistics aggregation to my riak-url-shortener. Thanks to help from Larry Karnowski (@karnowski), I dove into building a test harness today. I initially tried Jasmine, which has a very nice in-browser mode, but it assumed too much about having the BOM available. I ended up trying out a port of QuickCheck to Javascript (http://bitbucket.org/darrint/qc.js/) and so far I like the results. The declarative, functional orientation of QC is a good fit for testing your map and reduce functions, especially since they run in relative isolation. Without further ado, here's my first pass at the harness: http://github.com/seancribbs/riak-qc.js http://bitbucket.org/seancribbs/riak-qc.js (may go away) You'll need a standalone version of Spidermonkey (1.8rc1 or later) to run your tests. Once you have SM installed and the project cloned, try "js builtins_qc.js" from the terminal. Caveat emptor -- this is only one day's work! Nevertheless, try it out and give me feedback or send pull-requests. Sean Cribbs Developer Advocate Basho Technologies, Inc. http://basho.com/ ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com