[jira] Created: (HADOOP-7014) Generalize CLITest structure and interfaces to faciliate upstream adoption (e.g. for web testing)

2010-10-29 Thread Konstantin Boudnik (JIRA)
Generalize CLITest structure and interfaces to faciliate upstream adoption (e.g. for web testing) - Key: HADOOP-7014 URL: https://issues.apache.org/jira/browse/HADOOP-

Build failed in Hudson: Hadoop-Common-trunk-Commit #408

2010-10-29 Thread Apache Hudson Server
See Changes: [cutting] HADOOP-7011. Fix KerberosName.main() to not throw an NPE. Contributed by Aaron T. Myers. -- [...truncated 20208 lines...] [junit] at sun.reflec

[jira] Resolved: (HADOOP-6990) Move TestSequenceFile from MapReduce to Common

2010-10-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HADOOP-6990. --- Resolution: Duplicate Fixed in HADOOP-6991 > Move TestSequenceFile from MapReduce to Common

Re: mapper and reducer scheduling

2010-10-29 Thread Harsh J
Hello, On Fri, Oct 29, 2010 at 12:45 PM, Jeff Zhang wrote: > TaskTracker will tell JobTracker how many free slots it has through > heartbeat. And JobTracker will choose the best tasktracker with the > consideration of data locality. Yes. To add some more, a scheduler is responsible to do assignm

Re: Multi-Master Hadoop Configuration

2010-10-29 Thread Steve Loughran
On 27/10/10 23:28, Wang, Chengwei wrote: Thanks for pointing it out! Because it did not mentioned how may masters in the practice of 4000 nodes, is there only one master managing 4000 slaves? Given that you can now get 24 TB worth of HDD in a single server, I wouldn't worry that much about

Re: mapper and reducer scheduling

2010-10-29 Thread Jeff Zhang
TaskTracker will tell JobTracker how many free slots it has through heartbeat. And JobTracker will choose the best tasktracker with the consideration of data locality. On Thu, Oct 28, 2010 at 2:52 PM, Zhenhua Guo wrote: > Hi, all >  I wonder how Hadoop schedules mappers and reducers (e.g. consid