Re: Throttling ColumnFamilyRecordReader

2010-10-20 Thread Michael Moores
sorry i had a misunderstanding of the MapRed report output. i did reduce mapreduce.tasktracker.map.tasks.maximum (number of concurrent maps per node) from the default of 2 to 1. i suppose if i want to do this on a per job/user basis i'll try out the hadoop fair scheduler. On Oct 19, 2010, at

Re: Throttling ColumnFamilyRecordReader

2010-10-19 Thread Jonathan Ellis
(Moving to u...@.) Isn't reducing the number of map tasks the easiest way to tune this? Also: in 0.7 you can use NetworkTopologyStrategy to designate a group of nodes as your hadoop "datacenter" so the workloads won't overlap. On Tue, Oct 19, 2010 at 3:22 PM, Michael Moores wrote: > Does it mak