Re: Parallel mapred jobs in Yarn

2011-11-09 Thread Bharath Ravi
Thanks a lot all! I'll try configuring the capacity scheduler on yarn, and get back to you if I run into any issues. On 9 November 2011 10:41, Robert Evans wrote: > The configuration options are somewhat different for yarn, then they are > for MRV1. You probably want to generate the documentati

Re: Parallel mapred jobs in Yarn

2011-11-09 Thread Robert Evans
The configuration options are somewhat different for yarn, then they are for MRV1. You probably want to generate the documentation for yarn mvn site And then read through it about how to set up your cluster ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/target/site/index.html There i

Re: Parallel mapred jobs in Yarn

2011-11-09 Thread Vinod Kumar Vavilapalli
FairScheduler isn't ported yet to YARN. The default scheduler is there ( which is FifoScheduler) and CapacityScheduler can be configured too. HTH, +Vinod On Wed, Nov 9, 2011 at 10:14 AM, Bharath Ravi wrote: > Thanks, Prashant! > I'll try Yarn out with the Fairscheduler. > > On 8 November 2011 0

Re: Parallel mapred jobs in Yarn

2011-11-08 Thread Bharath Ravi
Thanks, Prashant! I'll try Yarn out with the Fairscheduler. On 8 November 2011 01:01, Prashant Sharma wrote: > Yes! , you can do the same in yarn as well. > -P > > On Tue, Nov 8, 2011 at 3:24 AM, Bharath Ravi > wrote: > > > Hi all, > > > > I have a beginner's question: > > How can I configure y

Re: Parallel mapred jobs in Yarn

2011-11-08 Thread Prashant Sharma
Yes! , you can do the same in yarn as well. -P On Tue, Nov 8, 2011 at 3:24 AM, Bharath Ravi wrote: > Hi all, > > I have a beginner's question: > How can I configure yarn to allow multiple parallel mapreduce jobs to run? > Currently, the execution is sequential: each submitted job waits for the >

Parallel mapred jobs in Yarn

2011-11-07 Thread Bharath Ravi
Hi all, I have a beginner's question: How can I configure yarn to allow multiple parallel mapreduce jobs to run? Currently, the execution is sequential: each submitted job waits for the previous to run. In MR1, this could be done by enabling the fairscheduler/capacityscheduler. Is there a similar