I don't know if you'd observe much difference -- it's not a "bug". It does take time to combine the records. It would take longer if you didn't. Heap size is not relevant here, but yes that is a function of the Hadoop config. Have a look at the source code to see what generates which output and where.
On Wed, May 30, 2012 at 11:25 AM, Nikolaos Romanos Katsipoulakis < [email protected]> wrote: > > >>> I tried to change the code from the RecommenderJob setIOSort method, > but I noticed no change in the execution times. Maybe i will have to change > the heap size from the hadoop configuration file. Also, I would like to ask > you until which map-reduce job are the similarities computed? I need to get > the similarities for my application but not the recommendations. Thus, I > would like to exclude any computation that relates to the recommendation. > > Thank you >
