Re: Map Reduce and long queries -

2012-10-15 Thread Olav Frengstad
I use ``make_local_fun`` to send the fun's across the cluster: https://gist.github.com/510070 In my opinion you should be able to send Erlang string fun's, and use erl_eval to parse them. Unfortunately this is also allows for execution of any erlang code so security wise people might not want it,

Re: Map Reduce and long queries -

2012-10-15 Thread Bryan Fink
On Mon, Oct 15, 2012 at 4:13 AM, Olav Frengstad wrote: > Just as a note, using the Erlang pb client you can use the key filters > for 2i queries if you include the riak_kv_mapred_filters module in > your client code path. … > 2> Index = {index, <<"test">>, <<"$key">>, <<0>>, <<255>>}, > 2> {ok, Fi

Re: Map Reduce and long queries -

2012-10-15 Thread Olav Frengstad
> The word everywhere is to avoid key filters. It effectively does a > whole-bucket key-listing, and that starts to get seriously slow out past 100k > items. Since you say test queries work I'll presume you've debugged your map > and reduce on some queries where you manually add a set of keys. (

Re: Map Reduce and long queries -

2012-10-14 Thread Adam Lindsay
Hi David, The word everywhere is to avoid key filters. It effectively does a whole-bucket key-listing, and that starts to get seriously slow out past 100k items. Since you say test queries work I'll presume you've debugged your map and reduce on some queries where you manually add a set of ke