Hi, I was going through FAQs on Hadoop to optimize the performance of map/reduce. There is a suggestion to set the number of reducers to a prime number closest to the number of nodes and number of mappers a prime number closest to several times the number of nodes in the cluster. What performance advantages do these numbers give? Obviously doing so improved the performance of my map reduce jobs considerably. Interested to know the principles behind it.
Thanks, Richa Khandelwal University Of California, Santa Cruz. Ph:425-241-7763
