On 05/30/2012 01:29 PM, Sean Owen wrote:
I don't know if you'd observe much difference -- it's not a "bug". It does
take time to combine the records. It would take longer if you didn't. Heap
size is not relevant here, but yes that is a function of the Hadoop config.
Have a look at the source code to see what generates which output and where.
On Wed, May 30, 2012 at 11:25 AM, Nikolaos Romanos Katsipoulakis<
[email protected]> wrote:
I tried to change the code from the RecommenderJob setIOSort method,
but I noticed no change in the execution times. Maybe i will have to change
the heap size from the hadoop configuration file. Also, I would like to ask
you until which map-reduce job are the similarities computed? I need to get
the similarities for my application but not the recommendations. Thus, I
would like to exclude any computation that relates to the recommendation.
Thank you
Ok. Thank you for your immediate and accurate responses. I will examine
the code thoroughly then.
Again thank you.
Nick Katsipoulakis
