RE: Partitioners - How to know if they are working

2012-02-17 Thread ext-fabio.almeida
Hello David, I am following your tip! Thanks. Also, I configured a small cluster with three datanodes and on my MR program I printed every single key that the reducers received. I set three reducers(setNumReduceTasks). Analyzing the reducer outputs I could see that the keys were distributed as

Partitioners - How to know if they are working

2012-02-16 Thread ext-fabio.almeida
Hello All, I wrote my own partitioner and I would like to see if it's working. By printing the return of method getPartition I could see that the partitions were different, but were they really working? To answer that I got the keys that every reducer task processed and that was what I expected.