Hi,
This line in your log suggests that your hitting the limit for open file
handles.
> 2012-01-13 02:33:18.706 [error] <0.1953.0>@riak_kv_vnode:init:245 Failed to
> start riak_kv_bitcask_backend Reason: {{badmatch,{error,emfile}}
This knowledge base article [1] and this wiki page [2] should help.
Cheers
Russell
[1]
https://help.basho.com/entries/477233-i-see-errors-in-the-riak-logs-that-contain-error-emfile-in-the-message-what-do-they-mean
[2] http://wiki.basho.com/Open-Files-Limit.html
On 13 Jan 2012, at 01:35, kser wrote:
> The riak db had been running fine for more than 1 month.
> But today it keep crashing.
> Here is the log
>
>
> 2012-01-13 02:30:37.015 [error] <0.116.0> webmachine error:
> path="/riak/contexts"
> {error,{error,{badmatch,{error,insufficient_vnodes_available}},[{riak_kv_wm_keylist,produce_bucket_body,2},{webmachine_resource,resource_call,3},{webmachine_resour,resource_call,1},{webmachine_decision_core,decision,1},{webmachine_decision_core,handle_request,2},{webmachine_mochiweb,loop,1},{mochiweb_http,headers,5}]}}
> 2012-01-13 02:30:37.056 [error] <0.118.0> webmachine error:
> path="/riak/contexts"
> {error,{error,{badmatch,{error,insufficient_vnodes_available}},[{riak_kv_wm_keylist,produce_bucket_body,2},{webmachine_resource,resource_call,3},{webmachine_resour,resource_call,1},{webmachine_decision_core,decision,1},{webmachine_decision_core,handle_request,2},{webmachine_mochiweb,loop,1},{mochiweb_http,headers,5}]}}
> 2012-01-13 02:30:37.078 [error] <0.120.0> webmachine error:
> path="/riak/contexts"
> {error,{error,{badmatch,{error,insufficient_vnodes_available}},[{riak_kv_wm_keylist,produce_bucket_body,2},{webmachine_resource,resource_call,3},{webmachine_resour,resource_call,1},{webmachine_decision_core,decision,1},{webmachine_decision_core,handle_request,2},{webmachine_mochiweb,loop,1},{mochiweb_http,headers,5}]}}
> 2012-01-13 02:33:18.706 [error] <0.1953.0>@riak_kv_vnode:init:245 Failed to
> start riak_kv_bitcask_backend Reason:
> {{badmatch,{error,emfile}},[{bitcask,scan_key_files,3},{bitcask,init_keydir,2},{bitcask,open,2},{riak_kv_bitcask_backend,start,2},{riak_kv_vnode,init,1},{riak_core_vnode,init,1},{gen_fsm,init_it,6},{proc_lib,init_p_do_apply,3}]}
> 2012-01-13 02:33:18.707 [error] <0.174.0> gen_server riak_kv_vnode_master
> terminated with reason: no match of right hand value
> {error,{{case_clause,ok},[{riak_core_vnode,init,1},{gen_fsm,init_it,6},{proc_lib,init_p_do_apply,3}]}}
> in riak_core_vnode_master:get_vnode/2
> 2012-01-13 02:33:18.708 [error] <0.1953.0> CRASH REPORT Process <0.1953.0>
> with 0 neighbours crashed with reason: no case clause matching ok in
> riak_core_vnode:init/1
> 2012-01-13 02:33:18.709 [error] <0.174.0> CRASH REPORT Process
> riak_kv_vnode_master with 0 neighbours crashed with reason: no match of
> right hand value
> {error,{{case_clause,ok},[{riak_core_vnode,init,1},{gen_fsm,init_it,6},{proc_lib,init_p_do_apply,3}]}}
> in riak_core_vnode_master:get_vnode/2
> 2012-01-13 02:33:18.710 [error] <0.95.0> Supervisor riak_core_vnode_sup had
> child undefined started with {riak_core_vnode,start_link,undefined} at
> <0.1953.0> exit with reason no case clause matching ok in
> riak_core_vnode:init/1 in context child_terminated
> 2012-01-13 02:33:18.710 [error] <0.170.0> Supervisor riak_kv_sup had child
> riak_kv_vnode_master started with
> riak_core_vnode_master:start_link(riak_kv_vnode, riak_kv_legacy_vnode) at
> <0.174.0> exit with reason no match of right hand value
> {error,{{case_clause,ok},[{riak_core_vnode,init,1},{gen_fsm,init_it,6},{proc_lib,init_p_do_apply,3}]}}
> in riak_core_vnode_master:get_vnode/2 in context child_terminated
>
>
> --
> View this message in context:
> http://riak-users.197444.n3.nabble.com/Keep-Crashing-tp3655458p3655458.html
> Sent from the Riak Users mailing list archive at Nabble.com.
>
> _______________________________________________
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
