Re: Hadoop's deafult FIFO scheduler

Hi, Sorry for a delayed response. Once jobs are submitted, they are setup by running the setup task. These are run in order of submission. However, the setup task itself runs on any free map or reduce slot on any node. I can imagine scenarios where the setup task of a job that was submitted later

Re: About MapReduce's Setup

Hi, Apologies for a very delayed response. The setup task is under the control of the user, and the user can provide an implementation that makes sense for his/her M/R job. That said, like with other APIs in M/R, there is an implementation that comes in the library for the common use cases. For e

Re: what happens inside hadoop !!

Harsh J wrote: > The source is your friend. In particular, start with JobTracker.java: initJob() for Job and TaskInProgress creation/init, and heartbeat() for Task creation. TaskTracker.java, JobInProgress.java, TaskInProgress.java, *Task.java, *TaskRunner.java, *TaskController.java, and JvmMan

Re: what happens inside hadoop !!

The source is your friend. And perhaps a good Java IDE too. I use Eclipse + F3. But since you ask, you may begin at the wiki: http://wiki.apache.org/hadoop/FrontPage There's stuff there not many see, and those pretty much cover enough to get you started at the right places :) About a document, I g

Re: what happens inside hadoop !!

http://hadoop.apache.org/hdfs/docs/current/api/index.html Javadocs is helpful. You can see how/which methods are called i.e., how things are happening. On Fri, Oct 22, 2010 at 10:31 AM, Ahmad Shahzad wrote: > Hi ALL, > Is there any documentation or guide or any presentation about > wha

what happens inside hadoop !!

Hi ALL, Is there any documentation or guide or any presentation about what happens inside hadoop. I mean, there are different documentation about map-reduce and hdfs and they tell what the do, but what is happening inside is not mentioned in those articles. Any idea !! Ahmad

Hudson build is back to normal : Hadoop-Common-trunk #489

See