Hi, I was trying to optimize Hadoop-1.0.2 performance by setting *mapred.tasktracker.map.tasks.maximum ,**mapred.tasktracker.reduce.tasks.maximum* such that the entire memory is utilized. The tuning of this parameter is given as (CPUS > 2) ? (CPUS * 0.50): 1 for reduce and (CPUS > 2) ? (CPUS * 0.75): 1 for map. I didn't quite get how they made this suggestion ? Isn't the setting dependent on main memory available? For example I had 48GB of memory and I split the parameters as 32 for mappers and 12 for reducers and remaining 4 for OS and other processes. Please correct me if my assumption is wrong.Also suggest a way to get the optimal performance by setting these parameters. Thanks.
-- --With Regards Pavan Kulkarni