Jon -
I think I can explain the behavior you're experiencing. During work leading up
to the 0.13 release the logic around how and when reduce functions are called
was subtly changed. The change caused reduce functions to be called with empty
input at the end of a job immediately prior to the r
Hi Jon,
If the map function is only returning '1' for each object there is no need
to distinguish between map inputs and reduce inputs.
For example, imagine we have 5 objects in our "test" bucket and the initial
batch of results to reduceSum only includes 3 of the objects:
[1,1,1] -> reduceSum ->
On Nov 29, 2010, at 12:15 PM, Dan Reverri wrote:
> Note the following from the article:
> "The important thing to understand is that the function defining the reduce
> phase may be evaluated multiple times, and the input of later evaluations
> will include the input of earlier evaluations."
>
Jon -
I am digging into your MapReduce bug right now and will share the results of my
pokings shortly.
--Kevin
On Nov 29, 2010, at 10:08 AM, Jon Brisbin wrote:
>
> On Nov 29, 2010, at 8:59 AM, David Smith wrote:
>
>> On Mon, Nov 29, 2010 at 7:43 AM, Jon Brisbin
>> wrote:
>>> I'm working on
On Mon, Nov 29, 2010 at 8:08 AM, Jon Brisbin
wrote:
>
> There's two problems I'm seeing, one is with map/reduce, the other is that
> the server will crash under the load the tests put on it (I'll send a
> separate email with steps to reproduce).
I'd be very interested to see this crash. The onl
Hi Jon,
It looks like Riak 0.13 may be running an initial empty reduce phase; we'll
look into this issue. With that said, the reduce function you have defined
does not account for "re-reduce". The following article explains how reduce
phases work:
https://wiki.basho.com/display/RIAK/MapReduce#MapR
On Nov 29, 2010, at 8:59 AM, David Smith wrote:
> On Mon, Nov 29, 2010 at 7:43 AM, Jon Brisbin
> wrote:
>> I'm working on the Spring Data and Grails Gorm support for Riak and I'm
>> seeing some problems running my tests against Riak 0.13. I don't see these
>> problems when running 0.12.
>
> C
On Mon, Nov 29, 2010 at 7:43 AM, Jon Brisbin
wrote:
> I'm working on the Spring Data and Grails Gorm support for Riak and I'm
> seeing some problems running my tests against Riak 0.13. I don't see these
> problems when running 0.12.
Can you elaborate on the problems you're seeing, please?
Than
I'm working on the Spring Data and Grails Gorm support for Riak and I'm seeing
some problems running my tests against Riak 0.13. I don't see these problems
when running 0.12.
I've mentioned this before in different venues, but since it's a Monday after a
holiday, I thought I'd bring it up again
