On Thu, Jan 31, 2013 at 1:46 PM, wrote:
> I'm try fix this bug.
> 1. Add fucntion for generating ConsHashCookie in riak_kv_mrc_pipe
> ...
> It's taking account of which nodes are up.
> 2. Remove Hash = chash:key_of(ConstHashCookie) in reduce2pipe function.
>
> After that all work fine.
Excellen
ные: Четверг, 31 Январь 2013 г 21:51:21
Тема: Re: Differences between riak_client and riak_kv_mrc_pipe MapReduce
when one node is down.
Hello Bryan.
I'm detect problem.
Problem is in reduce phase.
1. See riak_kv_mrc_pipe:mr2pipe_phases implementation. It convert MapReduce job
end.
%%%%%%
Thanks,
Alexander Gunin.
- Исходное сообщение -
От: "Bryan Fink"
Кому: gu...@mail.mipt.ru
Копия: "John Daily" , "Riak-Users"
Отправленные: Четверг, 31 Январь 2013 г 17:03:09
Тема: Re: Differences between riak_client and riak_k
pipe_mapreduce_check_n(Count,N-1,{Good+1,Bad});
{not_available,_}->
pipe_mapreduce_check_n(Count,N-1,{Good,Bad+1});
Else->
{0,{runtime_error,Else}}
end.
%%%%%%
Thanks,
Alexand
On Thu, Jan 31, 2013 at 6:07 AM, wrote:
> Sorry John. You don't understand my question.
> 1. One node(I mean physical(erlang) node) in cluster is down.
> 2. It was down when i'm start job,when perform job and after it. We power off
> this node. It's under repair. But we don't remove this node fr
ое сообщение -
От: "John Daily"
Кому: gu...@mail.mipt.ru
Копия: riak-users@lists.basho.com
Отправленные: Четверг, 31 Январь 2013 г 1:58:38
Тема: Re: Differences between riak_client and riak_kv_mrc_pipe MapReduce when
one node is down.
Riak's MapReduce functionality cannot survive a
Riak's MapReduce functionality cannot survive a node failure. If a vnode
involved with a query fails while actively processing the request, the entire
query will have to be re-run. The failed query should be automatically
terminated, but you'll have to re-run the query yourself.
If you create q
We have 6 node riak cluster.I simple custom erlang application for custom
MapReduce job.
We start MapReduce job using riak_kv_mrc_pipe pipe module,for example -
Query = [{map, {modfun,Mod,MapFun},[do_prereduce,{from,1}], false},{reduce,
{modfun,Mod,ReduceFun},[{reduce_phase_batch_size, 1000}],
