Hi,
I am trying to get started with Riak, so installed the
'riak_1.1.4-1_i386.deb' on a Ubuntu 12.04 LTS 32bit System running in a
Virtual Box VM. I no not have any cluster.
>
> I have a script which does the following:
>
> 1. It creates 50 child processes which run in parallel
> 2. Each Child process does the following
> a. Creates 1000 entries using the provides REST interface. The entry
> is a simple json value with 4 attributes and an integer key. This goes
> through fine.
>
> The Json object is something like {"name": "Test1", "title":
> "This is the title for Test1", "count": 1, "pid": 1234}. The pid is the
> process ID of the process creating the entry. I later use this to query the
> entries created by the process.
>
> b. Reads the entries created by it. A Javascript Map function which
> is stored as an object is used to filter and return only the entries
> created by the process
>
>
> During the reads, I get the following errors in HTTP response:
>
>
>
> {"phase":0,"error":"[worker_limit_reached]","input":"{<<\"samples\">>,<<\"11505823\">>}","type":"result","stack":"[]"}
>
> and
>
> {"phase":0,"error":"[preflist_exhausted]","input":"{ok,{r_object,<<\"samples\">>,<<\"11506270\">>,[{r_content,{dict,7,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<\"Links\">>]],[],[],[],[],[],[],[],[[<<\"content-type\">>,97,112,112,108,105,99,97,116,105,111,110,47,106,115,111,110],[<<\"X-Riak-VTag\">>,78,109,90,48,101,81,88,51,55,54,85,120,120,115,68,101,71,108,76,77,71]],[[<<\"index\">>]],[],[[<<\"X-Riak-Last-Modified\">>|{1342,87419,992551}]],[],[[<<\"charset\">>,85,84,70,45,56],[<<\"X-Riak-Meta\">>]]}}},<<\"{
> \\n ...\">>}],...},...}","type":"forward_preflist","stack":"[]"}
>
> The crash log has these:
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Module riak_kv_pipe_get must be purged before loading
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_pipe_get.beam
> failed: not_purged
> 2012-07-12 15:24:10 =ERROR REPORT====
> Module riak_kv_pipe_get must be purged before loading
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_pipe_get.beam
> failed: not_purged
> 2012-07-12 15:24:10 =ERROR REPORT====
> Module riak_kv_pipe_get must be purged before loading
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_pipe_get.beam
> failed: not_purged
> 2012-07-12 15:24:10 =ERROR REPORT====
> Module riak_kv_mrc_map must be purged before loading
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_mrc_map.beam
> failed: not_purged
> 2012-07-12 15:24:10 =ERROR REPORT====
> Module riak_kv_mrc_map must be purged before loading
>
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_mrc_map.beam
> failed: not_purged
> 2012-07-12 15:24:10 =ERROR REPORT====
> Loading of /usr/lib/riak/lib/riak_kv-1.1.4/ebin/riak_kv_mrc_map.beam
> failed: not_purged
> 2012-07-12 15:24:11 =ERROR REPORT====
> Module riak_kv_mrc_map must be purged before loading
>
> 2012-07-12 15:24:12 =CRASH REPORT====
> crasher:
> initial call: riak_pipe_vnode_worker:init/1
> pid: <0.2303.0>
> registered_name: []
> exception exit:
> {init_failed,error,{case_clause,{error,{insufficient_vnodes,0,need,1}}}}
> in function gen_fsm:init_it/6
> in call from proc_lib:init_p_do_apply/3
> ancestors:
> [<0.340.0>,<0.339.0>,riak_core_vnode_sup,riak_core_sup,<0.93.0>]
> messages: []
> links: [<0.340.0>]
> dictionary:
> [{eunit,[{module,riak_pipe_vnode_worker},{partition,1050454301831586472458898473514828420377701515264},{<0.339.0>,<0.339.0>},{details,{fitting_details,{fitting,<0.1136.0>,#Ref<0.0.0.2622>,follow,1},0,riak_kv_mrc_map,{{jsanon,{<<"functions">>,<<"get_by_pid">>}},11043},{fitting,<0.799.0>,#Ref<0.0.0.2622>,sink,undefined},[{sink,{fitting,<0.799.0>,#Ref<0.0.0.2622>,sink,undefined}},{log,sink},{trace,{set,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[error],[],[],[],[],[],[],[],[],[],[],[],[],[]}}}}],64}}]}]
> trap_exit: false
> status: running
> heap_size: 987
> stack_size: 24
> reductions: 256
> neighbours:
> 2012-07-12 15:24:12 =SUPERVISOR REPORT====
> Supervisor: {<0.340.0>,riak_pipe_vnode_worker_sup}
> Context: child_terminated
> Reason:
> {init_failed,error,{case_clause,{error,{insufficient_vnodes,0,need,1}}}}
> Offender:
> [{pid,<0.2303.0>},{name,undefined},{mfargs,{riak_pipe_vnode_worker,start_link,undefined}},{restart_type,temporary},{shutdown,2000},{child_type,worker}]
>
>
> I did search the Basho site for the error messages and found that some
> configurtion changes in app.config and setting ulimit might help. But that
> didnt solve my problem.
>
> My ulimit is set as 'ulimit -n 4096'. I have also done the following
> changes to the app.config:
>
> diff /etc/riak/app.config /etc/riak/orig.app.config
> 65c65
> < %% {pb_backlog, 500},
> ---
> > %% {pb_backlog, 5},
> 80d79
> < {riak_pipe, [{worker_limit, 1000}]},
> 97,99c96,98
> < {map_js_vm_count, 2048 },
> < {reduce_js_vm_count, 2048 },
> < {hook_js_vm_count, 2048 },
> ---
> > {map_js_vm_count, 8 },
> > {reduce_js_vm_count, 6 },
> > {hook_js_vm_count, 2 },
> 110c109
> < {js_max_vm_mem, 800},
> ---
> > {js_max_vm_mem, 8},
> 115c114
> < {js_thread_stack, 1600},
> ---
> > {js_thread_stack, 16},
>
>
> Any pointers for this issue will be helpful.
>
> Regards,
> Balu
>
>
>
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
