Re: Parallel mapred jobs in Yarn

Thanks a lot all! I'll try configuring the capacity scheduler on yarn, and get back to you if I run into any issues. On 9 November 2011 10:41, Robert Evans wrote: > The configuration options are somewhat different for yarn, then they are > for MRV1. You probably want to generate the documentati

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

Hi all, *So far, the following patches have been committed and accepted for inclusion in 0.20.205.1:* *Key* *Assignee* *Reporter* *Summary* HADOOP-5124 Hairong Kuang Hairong Kuang A few optimizations to FsNamesystem#RecentInvalidateSets HADOOP-

[jira] [Created] (HADOOP-7812) http call when no authorization is sent throws a 401 with no error resonse

http call when no authorization is sent throws a 401 with no error resonse -- Key: HADOOP-7812 URL: https://issues.apache.org/jira/browse/HADOOP-7812 Project: Hadoop Common

[jira] [Created] (HADOOP-7811) TestUserGroupInformation#testGetServerSideGroups test fails in chroot

TestUserGroupInformation#testGetServerSideGroups test fails in chroot - Key: HADOOP-7811 URL: https://issues.apache.org/jira/browse/HADOOP-7811 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-7371) Improve tarball distributions

[ https://issues.apache.org/jira/browse/HADOOP-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved HADOOP-7371. --- Resolution: Duplicate Fix Version/s: 0.23.0 This has been resolved in Hadoop mavenization wit

[jira] [Created] (HADOOP-7810) add hadoop-tools.jar to 'hadoop classpath'

add hadoop-tools.jar to 'hadoop classpath' -- Key: HADOOP-7810 URL: https://issues.apache.org/jira/browse/HADOOP-7810 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.20.205.0, 0.24.0, 0.

Re: Parallel mapred jobs in Yarn

The configuration options are somewhat different for yarn, then they are for MRV1. You probably want to generate the documentation for yarn mvn site And then read through it about how to set up your cluster ./hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/target/site/index.html There i

Build failed in Jenkins: Hadoop-Common-0.23-Build #61

See Changes: [vinodkv] MAPREDUCE-3368. Fixed test compilation. Contributed by Hitesh Shah. [szetszwo] svn merge -c 1199396 from trunk for HDFS-2540. -- [...truncated 7628 lines...] [INFO]

Re: Parallel mapred jobs in Yarn

FairScheduler isn't ported yet to YARN. The default scheduler is there ( which is FifoScheduler) and CapacityScheduler can be configured too. HTH, +Vinod On Wed, Nov 9, 2011 at 10:14 AM, Bharath Ravi wrote: > Thanks, Prashant! > I'll try Yarn out with the Fairscheduler. > > On 8 November 2011 0