reuse JVMs across multiple jobs

2010-02-19 Thread Vasilis Liaskovitis
Hi, Is it possible (and does it make sense) to reuse JVMs across jobs? The job.reuse.jvm.num.tasks config option is a job specific parameter, as its name implies. When running multiple independent jobs simultaneously with job.reuse.jvm=-1 (this means always reuse), I see a lot of different Java P

build and use hadoop-git

2009-11-29 Thread Vasilis Liaskovitis
Hi, how can I build and use hadoop-git? The project has recently been split into 3 repositories hadoop-common, hadoop-hdfs and hadoop-mapred. It's not clear to me how to build/compile and use the git/tip for the whole framework. E.g. would building all jars from the 3 subprojects (and copying them