Hi Brad,
YARN scheduling does take care of data locality. In YARN, tasks are not
assigned based on capacity. Actually certain number of containers are
allocated on every node based on node's capacity. Tasks are executed on
those containers. While scheduling tasks on containers YARN scheduler
s
ir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> [image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
> PM---As par my e
As par my experience the MapReduce API is same for both YARN and MRv2.
Applications compiled again YARN should run smoothly on MRv1. Ans the vice
versa is also true.
And in general YARN is pretty stable now.
Regards,
Shekhar
On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar wrote:
> Would an appli
I am trying to talk to R from Resource Manager. To do that I have to set a
VM argument
-Djava.library.path=/Library/Frameworks/R.framework/Resources/library/rJava/jri/
I have tried to set this argument by adding following line in hadoop-env.sh
export
HADOOP_OPTS="-Djava.library.path=/Library/F
ote that
> TaskId/TaskAttemptID/Map/Reduce tasks are MapReduce concepts. So
> ResourceManager has no idea about them. MapReduce ApplicationMaster is the
> place where you can obtain more such MR specific information.
>
> If it is the later, your question is moot.
>
> HTH,
> +Vi
In ResourceManager, is there any way to findout if the assigned container
is going to execute a mapping task or a reduce task? I can access objects
Container, Application and Request in ResourceManager, can I somehow get
TaskId by using any of these objects?? Please let me know a way.
Thanks.
Issue Type: Bug
Affects Versions: 0.20.2
Environment: Linux
Reporter: Shekhar Gupta
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
